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ABSTRACT 

In Canada today there is a clear move toward a more 
outcomes-based education system* This report examines the state of 
high school student assessment and reviews standards and 
accountability strategies* It reports on the policies, programs, and 
initiatives in all provincial ministries or departments of education 
and a sample of school boards across the country* Data were derived 
from a telephone survey of departmental/ministerial representatives 
from all 10 provinces and the 2 territories and from a questionnaire 
that was mailed to 279 school boards* A total of 140 boards 
responded, a 50 percent response rate* Data show that both boards and 
ministries are putting more emphasis on the development of 
comprehensive policies to cover all aspects of student evaluation* 
There is some movement away from relying on paper-*and“*penci 1 testing 
as the sole means of evaluation; the use of more authentic, 
performance-based approaches and a greater variety of assessment 
techniques are being promoted* Some of the best practices in high 
school evaluation involve use of a broad range of assessment methods; 
introduction of or improvements to provincial examinations ; greater 
use of summative and formative evaluations ; greater emphasis on 
modifying evaluation for special-needs students; use of 
performance-based assessment; and more reporting to parents and the 
public* Thirteen tables are included* Appendices contain copies of 
the two questionnaires and selected school board material* (Contains 
19 references * ) (LMI) 
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Highlights of the Study 



1. Recent education reforms focusing on high achievement have highlighted the 
need for quality assessment at the provincial, as well as at the school, level. 

2. Since 1977, the number of jurisdictions (provinces and territories) with 
provincial examinations has increased from three to nine. 

3. All but one province and one territory have assessment programs in place for 
program and system evaluation. 

4. Classroom evaluation is becoming more comprehensive, covering a broader 
range of objectives than it has done traditionally. 

5. Teachers and other educational staff in the schools and boards play a major 
role in the design and administration of provincial assessment in all jurisdic- 
tions. 

6. Provincial assessments are beginning to include more extended response 
(essay) items and, in some cases, perfomiance evaluation of objectives that 
cannot be tested with paper and pencil instruments. 

7. Eighty-eight per cent of school boards have assessment policies covering the 
last three years of high school. 

8. Although there is a trend toward the use of more perfomiance evaluations, the 
most common methods of classroom evaluation are still te:tcher-made tests, 
homework, and projects. 

9. Eighty per cent of boards offer professional development activities in assess- 
ment training. However, only 46% of boards have a designated individual 
who is solely responsible for assessment and evaluation. 

10. Provincial assessments provide the main source of information for scholar- 
ship selection in all jun.sujcti'>ns where this infonnation is available. 

11. In many boards and ministries across the country, exemplary policies and 
best practices are being encouraged and implemented. 
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Chapter 1 



The Context of Student 
Assessment in Canada 



Introduction 

NEVER IN CANADA’S HISTORY has there been such an overriding concern 
with educational standards and academic achievement. The public is demanding 
that students leave school with a solid foundation in communication sxills, math- 
ematics, science, technology, and global understanding. The widely held belief 
that education is the key to a viable economy and global competitiveness has 
placed the system under great public scrutiny. National assessment and account- 
ability efforts, designed to promote learning and measure the effectiveness of this 
country’s education systems, are thriving. Most provinces have introduced gradu- 
ation certification examinations, as well as a variety of other province-wide as- 
sessment programs. 

In 1978, when the Canadian Education Association produced its previous 
document on evaluating academic achievement in the last three years of second- 
ary school in Canada', it found that nearly all provinces had dropped graduation 
examinations, which had been firmly entrenched in earlier decades. In fact, at that 
time, only Quebec and Newfoundland still maintained a comprehensive system of 
province-wide examinations. Today, in 1995, there has been a complete reversal; 
all but three of Canada’s 12 provinces and territories have returned to some type 
of secondary school examinations. As well, most provinces have undertaken ef- 
forts to establish clearly defined graduation outcomes and detailed program objec- 
tives for each subject area. There is clearly a move toward a much more out- 
comes-based education system, starting with the very early grades. 

This report revisits CEA’s previous publication and looks again at the 
state of high school student assessment in Canada. It reviews the present focus on 

1. V. R. Nybcrg, and B. Lee, Evaluatinff Academic Acliievcmc.nl in the Last Three Years of 
Secondary School in Canada (Toronto, ON: Canadian Education Asswiation, 1978). 



standards and accountability and reports on the policies, programs, and initiatives 
of all provincial ministries/depanments^ and a sample of school boards. It also 
looks at some of the best practices engaged in by the provinces. The general feed- 
back from those participating in the survey was extremely positive. Many re- 
spondents said a study of this type was long overdue and would be very useful to 
those engaged in education reform and the retooling of their systems. 



Standards and Accountability 

Historically, education has been seen as something that is useful in im- 
proving the quality of life for the individual, not the means by which the nation 
could achieve greatness. Today, however, education has become linked with na- 
tional well-being as much as it is to personal well-being. It is now one of the 
world’s most valued commodities, with every country striving to outdo others in 
order to hold a privileged position in the global economy. Although education has 
always been highly valued in this country, its marketability is now interconnected 
with the business and financial world of buying, trading and selling. It is this link- 
age that has forced public accountability onto a profession that previously had 
been accountable primarily to the profession itself. 

The business planning model, which focuses on such activities as strategic 
planning, quality service, total quality management, and benchmarking, is being 
implemented in the education system. The education equivalent, not unlike that 
found in other organizations, is founded on the same basic premises, taking the 
form of priority setting, establishing standards of performance, assessing educa- 
tional outcomes, developing educational indicators, and school improvement. Na- 
tional efforts, such as the School Achievement Indicators Program, the Pan-Cana- 
dian Educational Indicators Program, and the Report on Education in Canada, ini- 
tiated by the Council of Ministers of Education, Canada, could not have happened 
ten years ago. In spite of the clear provincial and territorial responsibility tor edu- 
cation, every jurisdiction has recognized its responsibility to support Canada’s po- 
sition in the world by striving to provide quality educational services. Because of 
the education-economy link, a great deal of emphasis has been placed on tl sen- 
ior high school and the quality of graduates. 

The United States has a longer history of linking education to national per- 
formance than Canada, perhaps because of its greater interest in maintaining its 
position as a world power. As far back as Sputnik, the U.S. recognized the need 
for better scientific education, if not the need for high levels of general education 
for its whole population. The full value of education was not recognized until the 
publication of A Nation at Risk in 1983 by the National Commission on Excel- 



2. Throughout this report the terms “ministry” and “department" are used interchangeably, 
as arc the terms “high school" and “secondary school.” 
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lence in Education. This scathing report roundly condemned the American educa- 
tion system. By the last half of the eighties, American politicians of every stripe 
were competing to be seen as the first and the greatest supporters of educational 
reform. Education had become one of the top priorities of the political agenda. 

The 1980s and early 1990s saw a flood of educational experimentation. 
There were the effective schools movement, the coalitions of essential schools, 
the charter schools, the alternative schools movement, outcomes-based education, 
and the list goes on. Out of all of these experiments came some excellent prac- 
tices, and as many or more counterproductive approaches to reform. Gradually, 
however, success stories began to emerge, and through systematic educational re- 
search and close observation, a pattern began to unfold. Researchers found that 
the key to success, as in most successful organizations, was consistently tied to 
clearly specifying outcomes; measuring those outcomes to see the extent to which 
they were being achieved; using the information gathered from assessments for 
feedback to students, teachers, and schools; and ensuring ongoing, formal moni- 
toring of the success in schools. These measures, along with decentralized, 
school-based decision making and centralized responsibility for educational ac- 
countability and performance, have proven to be viable and successful practices 
that are consistently associated with raising the achievement levels of students. 

By the mid-1980s, Canadians also began to think more seriously about 
student achievement. However, the whole issue of focusing on objectives and out- 
comes as the basis for successful schooling was still being resisted by many who 
had been educated in the self-actualization educational philosophies of the 1960s 
and ’70s. These philosophies, promoted by highly acclaimed educational commis- 
sions such as the Ontario Commission of 1968 (which issued the Hall-Dennis Re- 
port^ ), focused attention almost entirely on education for individual self-fulfil- 
ment. 

One of the first widely circulated Canadian reports to challenge the princi- 
ples and practices adopted by educators in the late sixties and early seventies, was 
the Ontario Study of the Relevance of Education, and the Issue of Dropouts. In 
that report, Radwanski suggested that the world was in the “midst of a socio-eco- 
nomic transformation every bit as fundamental as the earlier shift from the agrar- 
ian to the industrial era” and underscored the importance of education in a world 
moving “from exploitation of material resources to reliance on human knowl- 
edge.”'* It focused on the importance of education in social and economic well- 
being, as well as in personal development. His very first recommendation for 
change in education was as follows: 



3. Provincial Commission on Aims and Objectives in the Schools of Ontario (Hall-Dennis 
Report), Living and Learning (Toronto, ON: Newton Publishing, 1968). 

4. G. Radwanski, Ontario Study of the Relevance of Education and the l.\.'<ue of Dropout.'; 
(Toronto, ON; Ontario Ministry of Education, 1987), p. 2. 
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That the emphasis of educational philosophy in Ontario be shifted 
from process to outcomes, and that the objectives of education be 
defined in terms of the acquisition of specified demonstrable 
knowledge and skills by all children . . 

At least two more of Radwanski’s recommendations bear mentioning as 
they relate directly to the issues of achievement discussed here. They are. 

That. . .educational policy in Ontario set clear and sequential out- 
come goals for each grade; ^ 

and 

That standardized province-wide tests at least in reading compre- 
hension, writing, mathematics, reasoning and problem solving, 
and learning skills, as well as in other core curriculum subjects in 
high school, be administered to all elementary and high school stu- 
dents at appropriate intervals throughout the years of schooling.^ 

These recommendations, although not popular at the time, are very similar 
to those made in a number of Royal Commission reports over the past five years, 
including Ontario’s For the Love of Learning^, which was responsible for the re- 
cent establishment of the Education Quality and Accountability Office which will 
be implementing a province-wide testing, reporting and school improvement pro- 
gram for Ontario. 

The implementation secretariat of the Newfoundland Royal Commission, 
which produced Our Children, Our Future, ^ wrote in a recent implementation 
-.ocument. Adjusting the Course II, 

The overriding objective in all of our attempts to reform the system 
is to transform this society from one of persistent under-achieve- 
ment to one whose achievement ranks with the best in the nation.^° 



5. [bid., p. 195. 

6. Ibid., p. 198. 

7. Ibid., p. 199. 

8. Ontario Royal Commission on Learning, For the Love of Learning (Toronto, ON: 
Government of Ontario, 1994). 

9. Newfoundland Royal Commission, Our Children, Our Future: Royal Commission of 
Inquiry into the Delivery of Programs and Services in Primary, Elementary, Secondary EducaPon (St. 
John’s, NF: Newfoundland and Labrador Department of Education, 1992. 

10. Newfoundland Royal Commission Secr''tarial, Adjusting the Course ll (Si. John’s, NF: 
G( vemment of Newfoundland and Labrador, 1994), p. iii. 
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As a result of that objective, the Newfoundland and Labrador Commis- 
sion recommended introducing a wide range of assessment programs. These rec- 
ommendations are premised on the fact that improvement can only be made if 
achievement is consistently monitored, and that society generally will be im- 
proved by raising education standards. 

The Sullivan Royal Commission in British Columbia, coming right at the 
beginning of the accountability movement in Canada, recommended that the 
province “develop an assessment, evaluation, and standards framework in support 
of Primary, Intermediate, and Graduation programs... to be phased in over a ten- 
year period.”*' It further recommended monitoring changes to school systems, en- 
hancing the accreditation program, and reporting information on performance. 

In 1992, the New Brunswick Commission on Excellence in Education pro- 
duced a document titled Schools for a New Century . That document also recom- 
mended sweeping changes in student assessment and recognized the need for pub- 
lic accountability. 

Even those provinces without commissions and major task forces have in- 
troduced programs to consistently monitor achievement and promote excellence 
in classroom student evaluation practices. Furthermore, most have undertaken 
planning initiatives where they have specified goals and objectives for learning. 



Reforms and Secondary Schools 

When student certification examinations were initially introduced it was 
done to ensure that the principles of comparability and fairness were adhered to. 
Because many post- secondary institutions, employers, scholarship sponsors and 
others wished to use high school assessment results, it was felt that a grade should 
mean the same thing regardless of which school a student attended. Furthermore, 
if there were no common examinations, it was thought, post-secondary institu- 
tions would begin to administer their own entrance examinations, which may or 
may not reflect the curriculum of the schools. Common provincial examinations 
were seen as a convenient selection tool for many education and labour market 
purposes. 

Of course, examinations still serve these purposes and recent high school 
assessment reforms may not, on the surface, appear to be related to the account- 
ability movement. However, a review of the debates that took place before pro- 
vincial examinations and assessments were reintroduced in several provinces over 
the past few years shows that legislatures were clearly responding to the public 



1 1. Cited in British Columbia Ministry of Education, Enabling Learners: Working Plan U3 
(Victoria, BC; Government of Briti.sh Columbia,! 990). 

1?.. New Brunswick Commission on Excellence in Education, Schools for a New Century 
(Fredericton, NB; Government of New Brunswick, 1992). 
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concern about how prepared the youth leaving the schooling system were. Even 
provinces like Newfoundland, Quebec, and Saskatchewan, which have had pro- 
vincial certification examinations for generations, have begun to see the results of 
the examinations as a major source of accountability information, regardless of 
the initial reasons for introducing them. For example, Quebec has begun reporting 
examination results by school, and Newfoundland has been reporting results of 
examinations by board for several years. 

Today, all four Atlantic Provinces are engaged in the collaborative devel- 
opment of graduation outcomes. These outcomes are intended to influence both 
high school curriculum design and assessment practices, and the information col- 
lected through the assessment will be the centrepiece for a major accountability 
system, the Atlantic Provinces Educational Indicators Program. The Atlantic 
Provinces’ initiatives will likely mean common curriculum and assessment in key 
areas right across the Atlantic region. 

In spite of the accountability movement, assessment in the classroom is 
still within the purview of the teachers. Teachers are expected to use whatever 
student evaluation strategies best serve the learning needs of the students. To en- 
sure that teachers understand this important area, both preservice training pro- 
grams and in-service programs ii. student evaluation are now in great demand and 
are the major components in most professional development activities. Ministries 
in most provinces have taken steps to see that they have appropriate policies to 
guide the teachers’ work in this area. 

This study was initiated particularly to look at assessment policies and 
practices in the last three years of secondary schooling, not to review accountabil- 
ity and educational reform. However, student assessment, being what it is today, 
cannot be discussed without looking at the broader context in which it exists. 



A Brief Glance at Recent Assessment Reviews 

Reviewed here are a number of reports on educational assessment that 
have been conducted since 1978. It is not intended to be a complete review of the 
literature, and we acknowledge that other such documents are not discussed here, 
(some of these documents were not available to the authors, and others are not in- 
cluded because their findings are the same as those noted in more readily avail- 
able reports.) 

Evaluatinf) Academic Achievement in the Last Three Years of Secondary 
School in Canada reviewed practices in high school evaluation from 1960 to 
1977. Although this report had many significant things to say about educational 
evaluation, one of the more interesting was that in the approximately two decades 
covered by the study, most provinces had gone from having a comprehensive set 



13. V. R. Nyberg, ami B. Lee, op. cii. 



of provincial examinations to having none all. British Columbia, Alberta, Mani- 
toba, Ontario, Nova Scotia, and Prince Edward Island all completely dropped pro- 
vincial examinations for graduation purposes; New Brunswick maintained them 
only for French students; Saskatchewan went from all students writing examina- 
tions to only students who did not have accredited teachers; Quebec and New- 
foundland maintained examinations, but the students’ final mark now included a 
component provided by the school. Generally, the provinces that had dropped 
provincial examinations defended their decision on the basis that it was excessive, 
that teacher qualifications had improved, and that types of assessment more versa- 
tile than paper and pencil tests were needed. Other defences focused on the pres- 
sure being felt from educators and on a philosophical change based on the 
premise that those who taught were in the best position to evaluate. 

In a Summary of Provincial Assessment Practices in Canadian Public 
Education it was reported that by 1985 five provinces were administering com- 
pulsory final examinations at the secondary level: British Columbia, Alberta, Sas- 
katchewan, Quebec, and Newfoundland. British Columbia and Alberta had re- 
introduced provincial examinations in 1984. At that time, the number of examina- 
tions ranged from 150 in Quebec down to seven in Alberta. Quebec held examina- 
tions for most subjects in secondary levels 3, 4, and 5 (grades 9, 10, and 1 1), 
whereas other provinces had examinations only at the final high school year. In all 
five provinces final examination marks were combined with school marks to de- 
termine a final grade. Saskatchewan still only required those who did not have ac- 
credited teachers to write examinations. New Brunswick had just introduced a test 
in mathematics and English to be written at grade 11, but these examinations did 
not form part of the graduation requirement. Also, it is interesting to note that by 
1985, seven provinces had introduced testing programs for program evaluation 
purposes, but only British Columbia, Manitoba, and Newfoundland conducted 
this type of testing in secondary schools. 

In A Summary of Canadian Assessment Practices the authors reported 

that by 1988 there were six provinces and two territories with provincial examina- 
tions: British Columbia, Alberta, Saskatchewan, Quebec, New Biunswick 
(French), Newfoundland, Yukon (using B.C. eAaminations), and the Northwest 
Territories (using Alberta examinations). Other secondary level assessments were 
being conducted in British Columbia (mathematics, science and language arts in 
grade 10), Saskatchewan (Canadian Tests of Basic Skills [CTBS) in grade 12), 
Manitoba (reading, writing, mathematics, science at various grades), Ontario 
(chemistry, physics, mathematics, and geography on an alternating sample basis 
at various grades). New Brunswick (second language in grade 10, mathematics in 
grade 1 1, and CTBS and second language in grade 12), Nova Scotia (social stud- 

14. H. Schulz, Summary of Provincial Assessment Practices in Canadian Public Education 
(Winnipeg, MB: Manitoba Department of Education, 1985). 

1 5. R. Jones, and B. Carbol, A Summary of Canadian Assessment Practices (Victoria, BC: 
British Columbia Minisuy of Education, 1988). 
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ies, science, mathematics, and language arts in grade 12), and Newfoundland 
(CTBS in grade 12). In total, by 1988, nine provinces and two territories had 
some type of student assessment. 

Other sources of interesting information on assessment and assessment 
practices in Canada can be found in The Craft of Student Evaluation in Canada, 
Curriculum and Assessment Trends in Canada, Standardized Testing in Canada, 
and in the Canadian Journal of Education}^ 

Changes to Provincial Examinations and Assessment Practices 

Table 1 shows, in a general way, what has happened in the administration 



Table 1. Summary of Provincial Examination Data for 1960, 1977, 1985 and 1994 



Province 


I960 


1977 


1985 


1994 


British 

Columbia 


Provincial cxtuninalions 
for students from non- 
accrcdiied schools, 
private schoi'ls. and 
those wiili C. D. and E's 
from accredited 
schools. Examinations 
were also held for grade 
13 students 


No departmental 
exams for certifica- 
tion purfxises. Grade 
12 scholarship 
exams conducted by 
the Ministry of 
Education 


Departmental 
exams in grade 13 
and grade 12 
academic courses 


Grade 12 
departmental 
exams in 15 
academic courses 
as part of the 
requirements for 
graduation 


Alberta 


The High School iind 
University Matricula- 
tion Examination Board 
regulated grade 12 
exams 


No departmental 
exams. However, 
exams held for the 
puqiose of student 
ajipeals iind program 
evaluation 


Diploma exams for 
seven grade 12 
academic courses 


Departmental 
exams in seven 
academic areas 
as part of 
graduation 
requiremenLs 


Saskatchewan 


All grade 12 students 
wrote departmental 
exams to ensure 
uniform standards for 
awarding scholarships 


Students not having 
accredited teachers 
(35% of students) 
wrote departmental 
exams for 50% of 
their final mark 


Departmental 
exams in 27 grade 
12 courses for 
students of non- 
accredited teachers 


Departmental 
exams in nine 
academic areas 
for students of 
non -accredited 
teachers 


Manitoba 


Provincial exams for 
students in the last three 
years of secondary 
school supervised by 
the High School Board 
of Examination 


No provincial 
exams. Students 
evaluated by 
schools. High school 
achievement tests 
held annually by 
schools and 
department 


No provincial 
exams. Students’ 
marks were 
awjirded by the 
leachers/schools 


One provincial 
exam each year 
from one of 
seven academic 
courses 



16. L.D. McLean, I'he Craft of Student Evaluation in Canada (Toronto, ON: Canadian 
Education Association, U)H5); G. Mussio, Curriculum and Assessment Trends in Canada (Victo- 
ria, BC: British Columbia Ministry of Education, 19HH); and R. Traiib, Standardized Testing in 
Canada (Toronto, ON: Canadian Education Asscx:ialion, 1994); Canadian Journal of Education 
20:1 (1995). 
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Province 


1960 


1977 


19X5 


1994 


Ontario 


Grade 13 students wrote 
a provineial exam to eer- 
tify suecess in the gene- 
ral or academie program. 
Grade 12 was the 
school’s respK)nsibility 


No province- wide 
exams 


No provincial 
exams. Schools 
resix)nsible for 
100% of a 
student’s mark 


No depariinenlal 
exarn.^. Schools 
res|X)nsible for 
100% of a 
student’s mark 


Nova Scotia 


Province- wide exams 
conducted by the depart- 
ment for students in 
grades 1 1 and 12, These 
exams were required for 
graduation 


Ni' provincial exams 
for promotional 
pur})oses High 
School Acliievcment 
Tests in grade 12 for 
program evaluation 
puri>oses 


No provincial 
exams. Schools 
res|X)nsible for 
HK)%of a 
student's mark 


No provineial 
exams. Schools 
res|X)nsible for 
100% of a 
student’s mark 


Prinec 

Edward 

Island 


Examinations for grades 
10» IKand 12. Grade 10 
was set and marked by 
province; grades 11 and 
12 conducted and mark- 
ed by Athmtie IVovinces 
Examining Bojird 


No provincial exams 
were held 


No provincial 
exams. Schools 
resjx)nsible for 
100% of a 
simloni’s mark 


No provineial 
exams. Schools 
resjx)nsiblc for 
100% of a 
simlenl’s mark 


Newfound- 
land and 
Labrador 


Examinations for grades 9, 
1 0, and 1 1 ; grade 1 1 exams 
marked by the Atlantic 
Provinces Examining 
Board; the others by the 
province 


Provincial e.xams 
were still given to 
grade 1 1 simlenis. 
These exams were 
worth 5(Kv{ c)f the 
student's final mark 


Provincial (public) 
exams were hekl 
in the maioriiy of 
grade 1 2 courses 


Regular depart- 
mental examina- 
tions in 1 S courses 
across six subjet l 
areas 


Northwest 

Territories 


No data available 


No data available 


No data available 


Territorial exams 
(dev. by AB) 
written in seven 
courses 


Yukon 


No data available 


No data avadable 


No data available 


I'errilorial exams 
(dev. by BC) held 
in ten course areas 



Sources include V. Nyberg and R. Lee, Evaluaimy, Aradetnii- Achivvcnwnl in ihc Lasi 1 hrer Yt tirs of 
Secondary School in Ca/iada (Toronuy. Canadian [ulucaiion Associaiioiu 1*^>7K) and H. Scluill/., 
Sum/nary of Provincial Assessment Prariices in Canadian Puhlit: lulucaiion (VVinnijvj:: Maniloba 
Deparlnienl of Education, 19X5). 
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of examinations in Canada over the past 35 years. There are no data available for 
the Yukon and Northwest Territories for 1960, 1977, and 1985 because the previ- 
ous studies quoted did not gather data for these two jurisdictions. 



General Changes in Assessment Practices 

Since the Nyberg and Lee study, student assessment has become the 
centerpiece of most educational reform efforts and has unprecedented support 
both inside and outside the educational system. Although assessment has been 
given a strong accountability voice, the support within the profession has helped 
maintain and integrate professional evaluation standards and principles in the day- 
to-day practices of teachers. The document Principles for Fair Student A55e55- 
ment Practices for Education in Canada which covers both classroom and 

large-scale assessments, was developed by a widely representative group of Cana- 
dian educators, and it supports the professional demand for evaluation integrity. 

There is a general trend in both classroom and large-scale assessment to 
integrate curriculum, instruction and evaluation, and to ensure that assessment 
closely matches the objectives of learning. There is somewhat of a trend to move 
away from the practice of relying on paper and pencil testing as the sole means of 
evaluation, even though this study showed that it was still the primary means of 
evaluating students in the secondary school system. Current theory strongly pro- 
motes the use of more authentic, performance-based approaches to evaluation, 
and the use of a greater variety of techniques, even when paper and pencil tests 
make up a major component of assessment. Those who participated in this study 
were fully aware of current thinking and were promoting improved evaluation in 
their jurisdictions. 




17. Joint Advisory Commillcc, Principles for Fair Student Assessment Practices for 
Education in Canada (Edmonton, \B: University of Alberta, Centre for Research in Applied 
Measurement and Evaluation, 199.3). 
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Chapter 2 



Study Design and Methodology 



IN JUNE 1994, the Canadian Education Association undertook a study of the as- 
sessment techniques and policies used in evaluating academic achievement in the 
last three years of high school in Canada. The study was to focus on what govern- 
mental and district practices and policies were and the extent to which these poli- 
cies were being implemented and adhered to. An important dimension of this 
study was to solicit the views of education officials on best practices, positive 
changes, and on areas where more work and changes were needed. A further pur- 
pose of the study was to revisit an earlier CEA report to determine the extent to 
which the assessment of high school achievement had changed since the previous 
study was done. 



Guiding Questions 

To focus the study a variety of background information, related literature, 
and survey questionnaires were reviewed. Documents pertaining to provincial as- 
sessment policies and practices were collected from several provinces. The earlier 
CEA report on evaluating achievement in the last three years of high school 
served as a starting point for the research and the development of research ques- 
tions. The following general questions were fonnulated to guide the research, the 
interview protocol, and questionnaires; 



18. V. R. Nybcrg, and B. Lee, op. cit. 
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1. What changes have taken place in secondary school assessment since 
the previous CEA report? 

2. What is included in the policies of education departments/ministries and 
school boards regarding student assessment in the final three years of 
high school? 

3. What kinds of large-scale assessment programs are used for certifica- 
tion and for program evaluation by ministries/departments across the 
country? How are these programs administered? 

4. What changes have been made in evaluation practices and policies over 
the past ten years? Why were these changes made? 

5. What other changes are needed? 

6. How are policies implemented and monitored? 

7. How are results of assessment programs used? 

8. What are some of the best practices now in place for student evaluation 
in secondary school? 

9. How are assessments being used for the selection of scholarships? 

Survey Population 

Although it would have been desirable to survey all levels of professionals 
in the system and high school students, practical considerations such as cost and 
time limited the study to two groups: department/ministry and school board pro- 
fessionals in evaluation. In all cases, the provincial representative interviewed was 
the most senior administrator directly responsible for student evaluation pro- 
grams. At the boards, questionnaires were completed by a director/superintendent 
of education or a designate, usually an assistant director/superintendent. 

All ten provinces and the two territories were surveyed through a tele- 
phone interview. Before the formal interview, departmental/ministerial repre- 
sentatives were forwarded a list of the interview questions in a questionnaire for- 
mat. This allowed the representatives time to review policies and other documents 
thoroughly and to prepare for the interview. Essentially, the telephone interview 
was a means of qualifying representatives’ responses. 

A stratified random sample of school boards representing all provinces 
and territories was also drawn. Thirty-five per cent of boards or a minimum of ten 
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boards (in cases where 35% of the population totalled fewer than ten boards) were 
selected from each province. Since Prince Edward Island has a total of only three 
boards it was decided that all the boards there would be included in the study. The 
Yukon Territory, which does not have a system of school boards, has three super- 
intendents who are individually responsible for each of three areas. In an attempt 
to have a representative sample of the entire country, these three areas were in- 
cluded in the sample, producing a total sample size of 279 boards. Responses 
were received from 140 (50%) of these boards. 

Although the response rate was relatively low, the nature of the study was 
such that the statistical significance of the results was not the driving force. The 
intent was to provide a general overview of assessment in this country by choos- 
ing a sample that was both reasonable and representative. The sample selected al- 
lowed a relatively comprehensive look at every Canadian jurisdiction and enough 
information to make some general comments on the current state of student evalu- 
ation in those jurisdictions. 

Item Development and Data Collection 

The primary purpose of the telephone interview was to provide an over- 
view of the practices and policies followed in each of the provincial departments 
of education. For this reason, most questions were open-ended so that responses 
would not be restricted. The interview also prompted additional comments and 
often provided an “other” category as a means of qualifying and enhancing the re- 
sponses. The jurisdictions and boards were also encouraged to send copies of as- 
sessment policies and guidelines, thus giving the researchers a better sense of 
what was being done. 

Some of the items included in the school board questionnaire were tailored 
to suit the data collected from the department/ministry interviews. The provincial 
representatives indicated the dimensions of the ministerial responsibilities and 
provided some knowledge about the roles of the school boards in certain practices 
and policies. Other items were included in the school board questionnaire to pro- 
vide information on topics not covered in the departmental interview. Generally, 
the questionnaire was more focused in scope and in the nature of the questions 
asked. It followed a close-ended format, providing a list of possible responses for 
most questions. However, like the telephone interviews, allowance was made for 
"othev" responses and additional comments. 

Analysis of Data 

Evaluating high school students is a broad topic and a study like this can 
generate a wealth of views and opinions. This makes it difficult to conduct tradi- 
tional statistical analyses that identify significant differences in data. Because of 
the amount and type of data collected and the desire to keep the report non-techni- 
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cal and easy to read, no advanced statistical analyses were conducted. 

The ministerial interview, A thematic analysis was conducted on the data 
collected from the telephone interview. That is, data were categorized and coded 
so that general themes and trends in responses were identified. The summary 
tables and charts outline the more common responses given to the interview ques- 
tions. 

The school board questionnaire. The school board questionnaire did not 
require the same degree of coding and categorization as the interviews since most 
questions were asked in a close-ended format. A database structure was set up so 
that a frequency analysis could be conducted and trends and themes in the data 
could be identified. The summary tobies and charts outline the details of the re- 
sponses given. C 

After the data were reviewe^and analyzed, it became apparent that some 
informational gaps existed. Some of the provinces were contacted a second time 
to obtain additional information so that a complete and true picture of assessment 
in this country could be presented. Other reports and documents were also re- 
viewed as a means of validating and verifying the data collected. 

Need for Further Study 

As mentioned earlier, several constraints limited this study to just two 
groups. By surveying ministry and school board representatives, the report takes 
on an administrative slant. For a thorough understanding of the assessment tech- 
niques promoted and practised across the country, it would be necessary to survey 
representatives of schools. This would determine which practices are favoured by 
teachers and whether various policies are being implemented successfully. As 
well, students, parents, and employers need to be surveyed to gauge their reac- 
tions to new methods of evaluation. 
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Chapter 3 



Role of Ministries in 
Student Assessment 



ALL ministries OR DEPARTMENTS of education have, in recent years, 
taken a more active role in developing student assessment policy, whether for for- 
mal provincial assessment or for guiding how student assessment is conducted in 
the classroom. Some have developed a full set of guidi4|-;;principles, policies and 
guidelines: others simply promote the use of fair practices as spelled out in a 
number of current do^^uments in the evaluation field. In fact, the Principles of 
Fair Student Assessment Practices for Education in Canada was frequently re- 
ferred to as guiding much of the recent work being done at the provincial level in 
a number of provinces and at boards. As well, the Code of Fair Testing Practices 
in Education, developed by the Joint Committee on Testing Practices in the 
United States, was referred to by some respondents. 

This chapter deals with responses of the ministry/departmental officials to 
policy development, implementation, and monitoring; policy changes; policies 
and practices related to provincial examinations and program assessments; minis- 
try views of practices used in the provinces’ classrooms; and satisfaction with 
their own assessment policies. In some sections, the reporting (especially that 
covered in tables) becomes rather tedious, but an effort has been made to present 
information in a straightforward and easy-to-read manner. 



19. Joint Advisory Comniitlcc, Principles for Fair Student Assessment Practices for 
Education in Canada (Edmonton, AB: University of Alberta, Centre for Re.search and Applied 
Measurement and Evaluation, 1993). 

20. Joint Committee on Testing Practices, Code of Fair Testing Practices in Education 
fWashington, D.C,: Department of Education, 1988). 
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Provincial Student Assessment Policies 



At the time of the survey, all provinces indicated that they had policies 
that covered several aspects of student evaluation in the last three years of high 
school, but the degree of depth and involvement of the departments and ministries 
varied greatly. In some cases, provincial policy was little more than a specifica- 
tion of v/hat courses students needed to graduate, while other jurisdictions had 
policies, procedures and guidelines spelled out on all major areas of student 
evaluation. 

Policy Design and Implementation. The extent of the jurisdictions’ re- 
sponsibility for student evaluation policy design and implementation varied de- 
pending on the type of evaluation or assessment covered by the policy. For exam- 
ple, there appeared to be a much more specific set of policies for provincial ex- 
aminations than for other types of evaluation. In five of the provinces with provin- 
cial examinations, the department of education is responsible for both design and 
implementation of policy. In two provinces, the department and the boards are re- 
sponsible, and in the two territories, the examinations are the responsibility of the 
department of two other provinces. In other areas of assessment policy, the in- 
volvement of others in the system was much more evident. Some provinces indi- 
cated that the department and boards were equally involved in policy develop- 
ment and design, and others indicated that the department, boards, and schools 
were all involved. In some cases, where there were no provincial examinations, 
ministry officials indicated that only boards, or schools, or both, were responsible 
for assessment policy. 

Policy Implementation. All but one of the 12 jurisdictions indicated that 
they had methods in place for ensuring that polices, practices, and guidelines were 
implemented. (See Table 2.) A detailed analysis of the responses to this question 
showed nine broad options in use for implementing policy. These include: 

^ minister’s orders supplemented by policy guidelines 

publishing documents, handbooks, and providing guidelines 
on-site visits and reviews 

^ in-service sessions, workshops, and seminars 
1 / providing information and reporting results of provincial examina- 
tions and assessments 

^ formation of specialist implementation teams for new policies 
^ assigning co-ordinators for administering examinations 
^ centralized marking stations with training sessions 
^ collecting data and reviewing results from school evaluations 

Only one province said that implementation was done .solely by order of 
the minister, supplemented by documents on evaluation and assessment. There 
were several cases where published documents were used in implementation but 
this was done along with other strategies such as in-service sessions and reporting 
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Table 2. Provincial Student Assessment Policies 



Province 


Who Designs and Implements Policies for: 


How is Provincial Policy 
Implemented? 




Provincial 

Exams 


Other Provincial 
Assessment 




British 

Columbia 


Prov ince 


Province and boards 


Minister's order; disuibuting 
documents 


Alberta 


Province 


Province and boards 


On-site visits; reviewing data 
from school assessments 


Saskatchewan 


Province, boards, 
and schools 


Province, boards, 
and schools 


Distributing documents; 
in-service 


Manitoba 


Province 


- 


Department provides informa- 
tion on |>rovincial testing 
results 


Ontario 




Province and boards 


Workshops, seminars; 
publishing documents; 
s()ccialist teams implement 
new' policies 


Quebec 


Province and boards 


Province and bo:uds 


Department provides publishec 
information, workshops, 
seminars 


New Brunswick 


French: Province 
and boards 
English: Province 


French: Province 
and boards 
English: Province 
boards and schools 


French: Department provides 
provincial testing results and 
guidelines; co-ordinators 
assigned to administer exams; 
cenualized marking stations 
for provincial exams 
English: Department provides 
documents, testing results and 
guidelines; in-service; 
centralized marking stations 
for provincial exams 


Nova Scotia 




Province, boards, 
and schools 


Department provides guide- 
lines 


Prince Edward 
Island 


- 


Prov ince, boiuds 
and sduwls 


Workshops, seminars 


Newfoundland 
and Labrador 


Province 


Province ;ind boards 


In-serv'ice; workshops, 
seminars; department provides 
guidelines, information 


Northwest 

Territories 


Territory, and another 
province (Alberta) 


Territory :mtl 
bojirds 


On-site visits; provide data 
results form provincial exams 


Yukon 


Territory and another 
province (BC) 


Teiritory and 
schools 


Department provides guide- 
lines; W'ork shops, seminars 
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results. One province and one territory mentioned that on-site visits and reviews 
of implementation strategies are regularly carried out, a number noted that they 
conduct in-service sessions and workshops as a primary method of implementing 
policy. Seven said that they formally report results of assessments as part of their 
implementation strategy, one indicated that they use specialist teams in conjunc- 
tion with workshops and publications, one collects and reviews school level 
evaluation data, and three said that provincial examination development and 
marking are used as a means of bringing people together for training sessions. 

Policy Changes. All but one of the 12 jurisdictions indicated that there 
had been policy changes in student assessment over the past ten years. Although 
many changes were noted, they are categorized into these six groupings: 

• provincial examinations 

• evaluation strategies 

• implementation strategies 

• implementing provincial level program evaluation 

• teacher accreditation 

• modified evaluation and programs for special students 

Since each of the 12 jurisdictions could have made one or more changes 
related to one or all of these areas, the total changes were numerous. Changes to 
provincial examination were mentioned most often in ministry responses; four of 
these departments mentioned the actual introduction of examinations in the prov- 
ince. Changes to policies to help improve evaluation strategies were mentioned 
eight times; improving implementation of evaluation policies through increasing 
publications and workshops were mentioned six times; policies related to using 
and introducing provincial program assessments were referred to several times; 
and teacher accreditation and modified evaluation were mentioned twice. 

Although a number of reasons were given for making the policy changes 
referred to in Table 3, the reasons can be categorized into four groups: 

• raising levels of achievement 

• improving accountability for performance 

• giving support for changes in curriculum emphasis 

• improving the quality of the assessment program 

By far the most common reasons given for making changes were related to 
improving accountability and raising levels of achievement. In all 11 jurisdictions, 
changes had taken place within the past ten years; most had taken place over time 
rather than all at once. 

When asked if boards could change policies adopted by the departments/ 
ministries of education, the department officials gave varied answers. Five said 
yes, four said no, and three said that some policies could be changed but others 
could not. In fact, most provinces with provincial examinations had policies that 
had to be stringently follov/ed, but other policies, which provided guidelines for 
school assessment, could be adapted somewhat or even changed completely in ' 
some cases. Classroom evaluation seems to be left pretty much to the school and 
the board. 
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Table 3. Recent Changes in Assessment Policies 



Province 


Year of 
Changes 


Changes Made 


Reasons for 
Changes 


British 

Columbia 


1988-1993 


- increased reliance on performance 
evaluations 

-weight of final exams was reduced 
from 50% to 40% 

- released Improving the Quality of 
Education 


- to be more responsive to public 
concerns 

- need to be more accountable to the 
public for the school system 


Alberta 


1985 


- introduction of program policy 
manual 

- formal policies tied to the 1984 
management and finance plan were 
introduced (emphasis on outcomes 
achieved) 


- department wanted to focus more 
on the outcomes of learning (vs, the 
process) 


Saskat- 

chewan 


1988-89 


- new assessment strategies incorp- 
orated into recent curriculum 
documents 

- a broader range of authentic 
assessment strategies encouraged 

- Plans to change formal of provincial 
exams to include more open -response 
questions 


- to support the implementation of 
new core curriculum 


Manitoba 


1990-91 


- one exam per year introduced 
in grade 1 2 


- perceived lack of uniformity in 
standards from school to school 


Ontario 


1986-87 


- handbooks developed for 9 OACs 

- OAC teacher in-service program 
introduced 

- introduced system of program 
evaluation 


- to meet concerns about inconsisten- 
cies in marks across schools 

- need for accountability in the 
system 


Quebec 


past 10 years 


- the "old" certification system 
replaced by the "iransiiional" system 
and then by the "new" system 

- increased emphasis on evaluating 
performance levels, abilities and 
attaining program objectives 

- raised pass mark from 50% to 60% 


- desire to place more emphasis on 
pupil year-long achievements 

- to share assessment responsibilities 
with school boards and schools 

- to encourage increased allainmenl 
of program objectives 


New 

Brunswick 


French: 

1991 


- provincial exam program was 
officially introduced 

- passing grade reduced from 60% 
to 55% 

t 


- need for more equity provincially 

- concerns abc^ul accountability for 
for school learning 

- to belter inform students, parents 
and taxpayers 

- to increase the quality of teaching 
and programs of study 




English: 

on-going 


- provincial exams reintroduced in 1985 

- provincial exams became criterion- 
referenced tests counting for 30% of 
the students' final marks for 

grade 1 1 English and math 


to expjmd the testing program 

- reaction to Schools for a New 
Century 

- to identify where problems of 
poor student achievement begin 
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Province 


Year of 
Changes 


Changes Made 


Reasons for 
Changes 


Nova 

Scotia 


past 10 
years 


- greater emphasis and dependence 
on collecting a wide range 

of assessment data for final evaluations 

- introduction of Nova Scotia Achievement 
Test 

- involved with the Maritime Provinces 
Education Foundation initiatives in 
curriculum development and assessment 
in math and science 


- to assess a wider range of 
expectations for learner outcomes 


Prince 

Edward 

Island 


1993-94 


- minister announces a return to provincial 
grade 12 exams (not yet implemented 
because of the Atlantic Provinces Educa- 
tion agreement on common core curriculm) 

- an agreement for common curricu- 
lum strategics was reached among 
the four Atlantic provinces 


- concerns about consistency^ 
content coverage and standards 

- concerns about consistency, 
content 

- desire for greater efficiency and 
increased quality in curriculum 
and assessment 


New- 

foundland 

and 

Labrador 


1991 


- published Evaluation of Students 
in the Classroom: A Handbook and 
Policy Guide 

- reduced number of provincial exams 
from 35 to 18 

- greater look at modified evaluation for 
students with disabilities 


- to encourage comprehensive 
assessments using a wide range of 
assessment techniques 


Northwest 

Territories 


— 


No major changes in past 10 years 


— 


Yukon 
1 


1993-94 


- diagnostic assessment program 

- construction of an item bank 


- improve instruction 

- explain current grades being 
achieved by students 



Provincial Examinations 

Seven provinces and two territories have examination systems in place 
that contribute to the certification of students. As shown in Table 4, only Ontario, 
Prince Edward Island, and Nova Scotia do not now have some kind of examina- 
tion system. However, in some provinces with examinations the impact on certifi- 
cation is minimal and graduation does not depend on writing these examinations. 
Even in jurisdictions where there are wide-scale highly valued examination pro- 
grams, there are special cases where students do not have to write examinations to 
graduate. For instance, under certain circumstances, regular students may be ex- 
empted from examinations. As well, some special needs students may acquire 
graduation status with modified courses or modified evaluations. Finally, special 
regulations may require only school evaluations of achievement from those stu- 
dents not wishing to continue further with their education. 
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Table 4, Provincial Examinations Across the Country 



Province 


When Exams are Held * 


In What Subjects 


1 

Do Policies Cover 
Special Education 
Students? 


British 

Columbia 


June and August. Selected 
subjects are offered for 
examination in 
November, January and 
and April 


L iteraturc, language, second 
language, mathematics, physics 
chemistry, geology, biology, 
geography, history, latin, 
communications 


Can receive special 
diploma issued by 
the province 


Alberta 


January, Juite, and August 


Laiiguage, second language, 
mathematics, physics, chemistry 
biology, social studies 


Can graduate only 
if provincially 
mandated courses are 
completed 


Saskat- 

chewan 


January, June, and August 


English, second language, math 
physics, chemistry, biology, 
social studies, economics 


Can get special 
diploma issued by 
province 


Manitoba 


One subject every year 


Language, mathematics, physics, 
chemistry, biology, geography, 
world issues (one examination per 
year on a rotational basis) 


Can get a certificate 
issued by die school 


Quebec 


January, June, and August 


Literature, language, second 
language, mathematics, physical 
sciences, chemistry, history 


Can get special 
school leaving 
certificate if individual- 
ized objectives are met 


New 

Brunswick 


French: January and 
June 

English: Annually 


French: Language, second 
language, mathematics, physics, 
chemistry, geography, history 
English: Literature, language, 
mathematics 


French: Can get 
certificate from 
school 

English: Can get 
certificate from school or 
district 


Newfound- 
land and 
Labrador 


Final examinations (June), 
Supplementary examination? 
(November); extra language 
exam in January 


Literature, language, second 
language, physics, 
environmental science, chemistry, 
geology, biology, geography, 
history, world problems 


Can get provincial 
diploma if indiv- 
idualized objectives in 
mandated courses 
are met 


Northwest 

Territories 


Same as Alberta 


English, mathematics, physics, 
environmental science, chemistry, 
)iology, social studies 


Can graduate only 
if objectives of 
provincially mandated 
course arc met 


Yukon 


Same as British Columbia 


Literature, language, second 
language, mathematics, physics, 
chemistry, geology, biology, 
geography, history 


Can get a special 
letter issued by 
territory recog- 
nizing student's accom- 
plishments 



•Source: A Survey of Student Assessment! Evaluation in Canada (I'oronlo: Council of Mlnlslcrs of Education, Canada, 
Alberta Working Group, 1994). 
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British Columbia, Alberta, Quebec, francophone New Brunswick, and 
Newfoundland have the most comprehensive sets of examinations; all primary 
academic subject areas are tested. Table 4 shows that all these provinces test in 
language/literature, mathematics, science, social studies, and second language. In 
most cases, the science areas of chemistry, physics, biology, and geology are 
tested separately, as are the social studies areas of history and geography. Also 
some provinces test separately in language and literature areas and in the different 
types of mathematics. In Saskatchewan, although there is a full set of examina- 
tions, they are given only to students who do not have accredited teachers; in 
Manitoba only one subject is tested annually; and in anglophone New Brunswick 
testing is done at grade 1 1 in mathematics and English, not in the graduating year. 
The Northwest Territories and the Yukon use examinations from Alberta and 
British Columbia respectively. 

In all jurisdictions except Manitoba and New Brunswick, diplomas are is- 
sued by the ministry/department of education. In those provinces the diplomas are 
provided by the school boards. 

In some cases special accommodations are made for students with learning 
disabilities so that they can receive a graduation certificate. Table 4 indicates how 
this is handled. 

Examination Development. In all provinces with provincial examinations, 
test development is the responsibility of the ministry/department of education. 
However, all of the provinces involve teachers or other subject area specialists 
from the school system. In all provinces, the examination development process is 
complex, adhering to most of the general theoretical principles of test develop- 
ment. The process normally includes developing tables of specifications, using 
specialists teams to write and field test items, validating items, preparing final 
forms based on data from validation and field testing, and finally reviewing items 
with departmental curriculum specialists. 

The format of the examinations varies from province to province. Most 
use a combination of multiple choice and extended response as shown in Table 5. 
The percentage of the exams that are objective and in essay form vary from sub- 
ject to subject as well as from province to province. 

All provinces and territories with provincial examinations have a certifica- 
tion system that provides for a final mark, which is made up of both the school 
evaluation and the examination. The weighting of the examination mark varies 
from 30% in Manitoba and anglophone New Brunswick, to 40% in British Co- 
lumbia and the Yukon, to 50% in all other provinces. (See Table 6, page 25.) 

Comprehensiveness of Examinations. Today many parents — and others 
— are asking how testing in high schools can improve the quality of the education 
system and its graduates. They complain that students graduate without solid ba- 
sic knowledge and skills in communication, mathematics, science, technology, 
and global understanding. They want to know how this can happen when every 
educatic^ system in the country clearly indicates that these subject areas, with 
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Table 5. Provincial Examination Format and Development 



Province 


Who Prepares 
Exams 


How Exams Are 
Prepared 


The Most Common 
Format 


British 

Columbia 


Ministry 


Several stages involving 
specialist teams and final 
review by the ministry 


Multiple choice and 
open-ended. Video 
component in French 
and fran^ais-languc, 
oral component in 
fran9ais-languc 


Alberta 


Ministry 


Several stages involving teacher 
advisory committees in 
conjunction with department 


Multiple choice, 
numerical and 
written response 


Saskatchewan 


Ministry 


Several stages involving accredited 
teachers and the dcparimcni 


Multiple choice and 
open-ended response 
items 


Manitoba 


Ministry 


Several stages involving specialist 
teams and final review 
by the dcparimcni 


Multiple choice, 
written response 


Quebec 


Ministry 


Several stages involving specialist 
teams and final review 
by the ministry 


Multiple choice, 
written responses 


New 

Brunswick 


Ministry 


French: Process with commiiiccs 
of teachers, specialists, and 
internal program and evaluation 
consultants 

English: Several stages with teacher 
advisory commiiiccs and department 


French: Short, 
written responses; 
English: Multiple 
choice and open- 
ended responses 


Newfoundland 
and Labrador 


Ministry 


Several stages involving teacher 
specialists and internal evaluation 
and program consultants; item banks 
are developed for some courses 


Multiple choice, 
completions and 
extended response 
items; oral and listening 
included in second lan- 
guage 


Northwest 

Territories 


Alberta Department 
of Education 


Same as Alberta 


Same as Alberta 


Yukon 


British Columbia 
Ministry of Education 


Same as British Columbia 


Same as British 
Columbia 



Source: Taken from A Survey of Student Assessment/Evaluation in Canada (Toronto: Couricil of Ministers of 
Education, Canada, Alberta Working Group, 1994). 
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their clearly specified outcomes, are important and are included in the primary . 
goals of education, as well as in graduation requirements. 

Since some students graduate without many essential skills and knowl- 
edge, parents, employers, and others are pressuring the education system to find a 
solution. Without these foundation skills, graduates are unable to make a smooth 
transition from school to higher education or to work. The education system is 
currently being charged with the responsibility for tackling this problem. 

One of the more interesting debates over this issue deals with the compre- 
hensiveness of the assessment of graduation outcomes in provincial examinations. 
There are a number of proponents both v/ithin and outside the education system 
who promote an examination system that is significantly more comprehensive in 
depth and coverage than any Canadian province or teiritory now provides. New- 
foundland, through the implementation of the recommendations in its recent 
Royal Commission report. Our Children, Our Future, is one of the provinces cur- 
rently engaged in this debate. 

Three of the most commonly discussed types of comprehensive examina- 
tions are: 

^ Non-subject-based examinations that test comprehensive basic 
knowledge and skills, which set rigid minimum standards for graduation as well 
as standards for “majority achievement” and for “excel;J.ence.” 

Comprehensive examinations that cut across subjects within a pro- 
gram area; i.e., examinations cover the full range of subjects in one area. In sci- 
ence, the single exam w'ould cover physics, chemistry, biology, geology, etc. 

(This applies to other program areas such as social studies, literature, mathemat- 
ics, communications.) 

^ Comprehensive examinations by subject areas, which would cover 
all levels of objectives in a high school. For example, in physics, a test would 
cover the full range of content and skills in all levels of the subject taught in the 
high school, rather than just that taught in exit-level courses. 

Whichever meaning is ascribed to comprehensive examinations, imple- 
menting the concept would mean a significant change in most examinations 
across the country. At present, nearly all examinations are course-based as indi- 
cated by the responses documented in Table 6. However, respondents indicated 
that the very nature of some courses (such as French, and, to some extent math- 
ematics and others) requires that previous knowledge and skills be included in the 
assessment. There is, however, no deliberate attempt to be comprehensive, except 
where it is dictated by the subject area. 
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Table 6. Comprehensiveness of Provincial Examinations 



Province 


Requirement 


Comprehensive 


Per cent 




for Graduation 


Exams 


Worth 




Yes 


No 


Y.s 


No 




British Columbia 


V 






'j 


40% 


Alberta 


V 






V 


50% 


Saskatchewan 




V 




V 


50% 


Manitoba 




V 




V 


30% 


Ontario 












Quebec 


V 






V 


50% 


New Brunswick 
French 








V 


40% 


English 




V 




V 


30% 


Nova Scotia 












Prince Edward Island 












Newfoundland and 
Labrador 




V 




V 


50% 


Northwest Territories 


V 






V 


50% 


Yukon 


V 






V 


40% 
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Table 7. Marking the Provincial Examinations 



Province 


How the P'xams Are 
Marked 


Who Marks the 
Kxams 


Why Scaling or 
Adjustment Is Done 


British Columbia 


Written responses 
by committee of 
teachers; multiple 
choice items by 
computer scanning 


Specialist teachers 
mark written 
responses; analysts 
scan multiple 
choice 


To ensure school marks and 
examination marks are 
consistent with each other 


Alberta 


Written respi^nscs 
and performance - 
based questions by 
committee of teachers; 
multiple choice by 
computer scanning 


Sj>ccialist teachers 
mark written 
responses; analysis 
scan multiple choice 


None 


Saskatchewan 


Written responses 
by committee of 
teachers; multiple 
choice by computer 
scanning 


Contracts, 
specialist teachers 
mark written 
responses; analysts 
scan multiple choice 


To ensure school marks and 
examination marks are 
consistent with each other 


Manitoba 


Written resptmscs 
by committee of 
teachers; multiple 
choice by optical 
scanning 


Subject JiTca 
teachers mark 
written resp<^nses; 
analysis scan 
multiple choice 


None 


Quebec 


Written responses 
by committee of 
teachers; multiple 
choice by computer 
scanning 


Subject area 
teachers mark 
written responses; 
analysts scan 
multiple choice 


To ensure consistency of 
standards among schools 
and to compensate for 
problems with 
examinations 


New Brunswick 
English: and 
French 


Written res|xmscs 
by committee 
of teachers; 
multiple choice by 
optical scanning 


Subject area 
teachers mark 
written responses; 
analysts scjin 
multiple choice 


French: to ensure marks 
do not misrepresent stu- 
dents* true performance 
English: to compensate for 
problems with examinations 


Newfoundland 
and Labrador 


Essays by special mark- 
ing board; multiple 
choice items by optical 
scanning 


Specialist teachers mtirk 
essay items: measurement 
analysis scan multiple 
choice 


To ensure consistency of 
standards among schools 
and to compensate for 
problems with examinations 


Northwest 

Territories 


Same as Alberta 


Siuiie as Alberta 


None 


Y ukon 


Same as British 
Columbia 


Same jls British 
Columbia 


to ensure that marks 
represent students’ true 
performance 
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Marking and Grading Procedures. Marking policies and practices, like 
most other aspects of examinations, vary from jurisdiction to jurisdiction as 
shown in Table 7. In most provinces, marking boards, normally made up of quali- 
fied teachers, are established to grade the extended response (essay) part of pro- 
vincial examinations. Usually objective responses (multiple choice primarily) are 
optically scored using suitable hardware and custom-made software. With the ex- 
ception of British Columbia, all jurisdictions use numeric grades ranging from 0 
to 100. 

In all jurisdictions except Quebec, where the pass mark is 60, and franco- 
phone New Brunswick, where the pass mark is 55, the passing grade is 50. Only 
Quebec and Newfoundland make any adjustments to marks submitted to the De- 
partment of Education by the schools. (See Table 8.) However, six jurisdictions 
(Yukon, British Columbia, Saskatchewan, Quebec, New Brunswick, and New- 
foundland) make adjustments to the examination mark. Only Alberta and Mani- 
toba say that they do not scale or adjust examination marks. 



Table 8. Summary of Grading and Reporting Information 



Province 


Passing 


Form of 


Issuing of 


Statistical 






Grade 


Reporting 


Diploma 


.Adjustments 












School 


Prov. 


Comb. 


British Columbia 


50% 


Letter 


Depi./Min. 


No 


Yes 


No 


Alberta 


50% 


Numeric 


Dept./Min. 


No 


No 


No 


Saskatchewan 


50% 


Numeric 


Dept./Min. 


No 


Yes 


No 


Manitoba 


50% 


Numeric 


Board 


No 


No 


No 


Ontario 


50% 


Numeric 


Dept./Min. 


No 


— 


— 


Quebec 


60% 


Numeric 


Dept./Min. 


Yes 


Yes 


No 


New Brunswick 














French 


55% 


Numeric 


Board 


No 


Yes 


No 


English 


50% 


Numeric 


Board 


No 


Yes 


No 


Nova Scotia 


50% 


Numeric 


Dept./Min. 


No 


— 


— 


Prince Edward Isl 


50% 


Numeric 


Dcpl./Min. 


No 


— 


— 


Newfoundland 
and Labrador 


50% 


Numeric 


Dept. /Min. 


Ye.s 


Yes 


Yes 


Northwest Terr. 


50% 


Numeric 


Dept./Min. 


No 


No 


No 


Yukon 


50% 


Letter 


Dept./Min. 


Yes 


Yes 


No 
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Quebec and Newfoundland say they adjust school marks to ensure that 
there is consistency of standards of marking among schools, whereas those who 
adjust provincial examination marks say that they do it to compensate for prob- 
lems with the examinations or to ensure that overall school marks and examina- 
tion rharks are consistent with each other. 



Student Evaluation for Program and System Evaluation 

Nearly all assessments put in place for evaluating programs and the per- 
formance of the education system were, of course, established to address the de- 
mand for accountability and improvement. Their purpose is also to determine the 
extent to which students in a particular school, district, province, country, etc., are 
achieving the aims and goals deemed to be of value to society and to general per- 
sonal development. Information gathered from these assessments is intended for 
boards and the provinces to use to target areas where improvements are needed, 
and to hold themselves accountable to students and public for doing whatever is 
necessary. 

In this type of evaluation, the stakes become higher for others than for the 
individual student. The administrators, teachers, and other professionals are being 
held accountable and responsible for ensuring the quality of the system by seeing 
that students achieve the goals agreed to by educators and society at large. As a 
result, educatois have a deep desire to ensure that these evaluations are appropri- 
ately designed, i dministered, and used. They want to ensure that the evaluation 
instruments are tue best that they can be. 

The survey showed that all provinces and territories use student evaluation 
results for program evaluation even when they do not have their own formal pro- 
gram assessments in place. Eight jurisdictions indicated that they had developed 
tests especially for evaluating how program goals were being achieved. In two 
others, provincial examination results (used primarily for student certification) are 
analyzed for program and system evaluation. Only one jurisdiction had no provin- 
cial assessments in place. Most jurisdictions also have participated in a number of 
national and international assessments over the years and have used the results to 
compare their general performance with that of others elsewhere. Also, as indi- 
cated in Table 9, a few systems even use commercial nationally normed tests to 
ensure they can consistently compare their students’ performance with a pre- 
established Canadian norm. 
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Table 9. Assessment for Proj»ram Evj 



Province 


What Type of Assessment is Used 


Sample or 
Census 


Type of 
Sample 




Provincial 


National 


Internationa! 


British 

Columbia 


CRTs' 


SAIP^ 


lEA Studies (SIMS/ 
SISS, TIMSS)’ 
and lAER* 


Both, depending 
on program 


Stratified 


Alberta 


CRTs 

and provincial 
exams results 


SAIP 


TIMSS and lAEP 


Both, depending 
on program 


Stratified 


Saskatchewan 


CRTs and 
CAT* 


Statistics 

Canada 

studies 


lEAP 


Sample 


Stratified 


Manitoba 


CRTs 


SAIP 


lEAP 


Sample 


Random 

or 

Stratified 


Ontario 


CRTs 


SAlP 


SIMS/SISS, lAEP 
and TIMSS 


Both, depending 
on program 


Stratified 


Quebec 


Provincial exam 
results 


SAIP 


lAEP and Interna- 
tional Baccalaureate 


Both, depending 
on program 


Stratified 


New 

Brunswick 


English: CRTs 
French: — 


SAIP 

SAIP 


lAEP and TIMSS 
lAEP 


Eng. &Fr.: Both, 
ilepending on program 


Eng. & Fr.: 
Random or 
Stratified 


Nova Scotia 


CRTs 


SAIP 


lEAP 


Both, depemling 
on program 


Stratified 


Prince Edward 
Island 




SAIP 


— 


Sample 


Stratified 


Newfoundland 
and Labrador 


CRTs, CTBS" 
and provincial 
exam results 


SAIP 


lAEP and TIMSS 


Sample 


Stratified 


Northwest 

Territories 


— 


SAIP 


— 


Sample 


vStratified 


Yukon 


CRTs 


SAIP 


— 


— 


Stratified 



^ CRT — Criterion Referenced Test 
9 

^ S AIP — School Achievement Indicators Program (Council of Ministers of Education, Canada). 

^ International Assessnienis of International Association for Evaluation of Educational Achieve- 
ment (lEA ) — SIMS/SISS and TIMSS (Second and Third International Malltcmatics and Science Studies) 

^ lAEP — International Assessment of Educational Progress — in mat hematics and science 
^ CAT — Canadian Achievement Tests, a set of basic skills tests develo|>ed by McGraw-Hill 
Ryerson Limited 

^ CTBS — Canadian Tests of Basic Skills, a set of basic skills tests developed by Nelson’s Canada 
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Table 10. Perceived Standards of Graduates by Subject Area 



Subject 


Number of Respondents (of 13)^ who Felt Student Performance 
Standards Had: 




Declined 


Remained the Same 


Increased 


No Opinion 


Mathematics 


2 


7 


4 


0 


Language 


1 


7 


5 


0 


Literature 


3 


6 


2 


2 


Second language 


0 


7 


5 


1 


Science 


1 


4 


9 


0 


Social studies 


1 


7 


5 


0 


Computer science 


0 


2 


8 


3 


Theaue arts 


0 


6 


5 


2 


Physical education 


1 


8 


3 


1 


Northern studies^ 


— 




1 


— 


Career and 
technology studies^ 








1 


_ 


^ New Brjnswick has been double counted because French and English systems operate as com- 


pletcly separate .entities. 

^ Listed as "other'' by one jurisdiction. 







Standards of Student Performance 

Respondents from the 12 jurisdictions were asked how they felt about the 
standards of achievement of students today compared to ten years ago. The survey 
identified a number of subject areas common to the secondary school curriculum 
in all provinces and posed questions about standards in each of these subject ar- 
eas. The responses were interesting, and, because of the reluctance of several con- 
tacts to be quoted, rather political as well. For this reason Table 10 does not refer 
to specific jurisdictions. The information is useful, however, since it indicates a 
pattern in responses. 

By far the largest number of respondents felt that the standards had re- 
mained the same over the past ten years, but in science and computer technology, 
areas where there has been a great deal of public pressure to improve student per- 
formance, a large number of respondents felt that standards had improved. Also, a 
few provincial contacts felt that standards had increased in their province in Ian- 
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guage (communication skills) and in second language learning. Literature was the 
area where the greatest number of jurisdictions felt that standards had declined. In 
spite of the increased emphasis on science, mathematics and technology in the 
past few years, five jurisdictions felt that standards had improved in other areas 
such as social studies and theatre arts. 

In addition to the eight subject areas presented to the respondents, two 
other areas were mentioned, each by one of the territories; Northern studies, and 
career and technology studies. 

One v/onders if standards in science and computer technology are being 
confused with the amount of effort and emphasis put on this area over the past 
decade. It has been indicated that any growth in this area, especially in technol- 
ogy, would show up as improvement, because it is new and virtually nothing was 
being done in this area a few years, ago. 

Use of Performance-Based Evaluation in Provincial Assessment 

Eight provinces indicated that they were using more performance-based or 
authentic evaluations in both school and provincial assessment. However, most 
provincial examinations tend to be primarily paper and pencil test items. There 
are, however, some cases in which performance-based evaluations are being used. 
For example, in writing, the process approach is used in testing, and in second 
language, some provincial examination and program assessments cover the full 
range of reading, writing, listening and speaking objectives using techniques clas- 
sified as “authentic” or performance-based. 

When all provincial/territorial officials had been interviewed, it was inter- 
esting to see that all together numerous subjects were identified as using some 
performance-based evaluation. The following is a complete list of the subject ar- 
eas referred to: communication skills, social studies, visual arts, history, theatre 
arts, physics, stenography, chemistry, vocational education, biology, second lan- 
guage, science, language arts, and mathematics. 

From looking closely at the responses, we see that most respondents con- 
sidered performance-based evaluation to include any assessment that went beyond 
the use of objective items (multiple choice, matching, etc.). That is, extended re- 
sponse (essay) items were considered performance-based evaluation, as were lab 
or hands-on observation evaluations. There is an obvious attempt to include this 
type of evaluation in many of the large-scale assessments now underway in 
Canada. Most respondents felt that the school portion of the evaluation of provin- 
cial examinations should be the performance assessment part. 



Methods of Evaluation in Schools 

Ministry officials said that unit tests were by far the most common method 
of evaluating students in high school classrooms, confirming that testing is per- 
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haps considered to be the most efficient and reliable method of evaluating a large 
range of academic objectives at secondary school. 

Officials from the i 2 jurisdictions were asked what they believed were the 
most common evaluation techniques used by teachers in high schools. The ques- 
tion was open-ended without any examples or prompts. Although most jurisdic- 
tions mentioned only three or four methods, some mentioned up to six. The 
number of times each of the following was listed as a primary method of evalua- 



tion is indicated below: 

Unit tests 1 2 

Science lab work 12 

Projects 8 

Assignments 5 

Performance-based assessment 5 

Final examinations 4 

Class work 2 

Peer evaluation 1 

Homework 1 

Portfolios 1 

Student-teacher interviews 1 



The traditional means of evaluating students remain high on the agenda 
for high school classrooms. Tests, which, of course, include final examinations, 
are not surprisingly the most common, because they are more easily developed, 
can be highly reliable, and can usually be administered to large groups in a class 
period. Other types of evaluation, such as performance-based ones and pupil- 
teacher interviews take time and can only be used sparingly where each teacher 
works with large numbers of students, as most high school teachers do. It was sur- 
prising, however, to have portfolios and homework so infrequently mentioned. It 
is worth noting that alternative types of evaluation methods are often used in 
evaluating the performance of students with various disabilities or needs. 

Satisfaction with Policies and Practices in Secondary Evaluation 

Officials were asked about the extent to which they were satisfied with as- 
sessment policies and practices in their province. This question offered a six-point 
forced choice response ranging from “very satisfied” to “very dissatisfied.” In 
most cases, respondents were positive about evaluation but only one jurisdiction 
gave evaluation in their province the top rating, five said they were “satisfied,” 
and four said they were “somewhat satisfied.” Three provinces, however, were 
dissatisfied, two “somewhat dissatisfied” and one “very dissatisfied.” 

They were also asked about changes they would like to see made in pro- 
vincial policy and practice.The responses suggested that there was a need to: 




40 



Emphasize the importance of using a broad range of evaluation strategies to 
reflect the full range of goals and objectives of programs, including, among 
others, the use of more authentic, hands-on evaluation; 

^ Provide more pre-service, in-service and professional development in class- 
room assessment; 

1/ Place more emphasis on, and formalize procedures to ensure better use of, 
results from provincial examinations and assessments; 

\/ Return to provincial examinations (where they were not already in use); 

v' Institute procedures to ensure more uniformity in the assignment of the 
school’s share of the provincial examination marks; 

%/ Put more emphasis on the development of more comprehensive criterion- 
referenced ass'^ssment; 

%/ Develop formal policies to cover more aspects than student assessment; 
Develop clearly defined curriculum outcomes; 

Establish a formal means for evaluation experts and ministry officials in 
Canada to communicate, collaborate, and share experiences in student 
evaluation efforts and initiatives. 

The most popular responses to the question of what changes should be im- 
plemented related to the need for evaluation to reflect a broader range of out- 
comes of educational achievement, to the need to return to more external testing, 
or to make better use of provincial assessment results where they already existed. 
Also, the need for more professional development in student evaluation seemed to 
be important. This was brought up on several occasions during the interviews 
with several respondents. 



Policy and Practical Changes Being Undertaken 

When provincial/territorial officials were asked if the changes or modifi- 
cations that they felt were necessai7 were being implemented, most indicated that 
such work was being done. Some noted that they were reviewing provincial ex- 
aminations and assessments to detemiine whether or not new methods of evalua- 
tion should be incorporated, some were looking at improving standard setting pro- 
cedures and graduation requirements, some were looking at a more formal and 



systematic procedure for reporting results, some were working with boards to de- 
velop indicators for reporting at the district and school level, some were working 
to improve or implement an accreditation system, and several were working to 
improve their policy documents. In fact, all provinces were involved in some type 
of evaluation and assessment retooling. Many were expanding their role to in- 
clude a more proactive role in designing, in conjunction with boards, policies and 
guidelines for evaluating students in the classroom. Interestingly, this was an area 
where most provinces had not been very much involved. 
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Chapter 4 



Role of the School Boards in 
Student Evaluation 



IN ALL PROVINCES AND TERRITORIES surveyed, school boards have the 
primary responsibility for student evaluation policies used by teachers in the 
classroom. They play a major role, as well, in implementing provincial policy and 
guidelines, and in administering system-wide assessments. Additionally, in some 
cases, school boards have a key role in administering provincial examinations. 

Of the 279 school boards that were surveyed, 140 responded. Thirty-nine 
per cent of those boards referred to themselves as rural, 32% stated they were ur- 
ban and 28% classified themselves as being a combination of both urban and rural 
(one board had no response to this question). Approximately 71% of the boards 
stated they had five or fewer high schools in their dist.dct and 90% of boards said 
had ten or fewer schools in their district. A large number of the boards responding 
(30%) had fewer than 500 high school students in the district. Of the 44 boards 
that fell into this category, 27 of them had senior high school enrolments of 200- 
400 students. Twenty-six boards had a student population of 501-1000 students. 
Thirteen boards had student populations of over 50()(). 

Student Assessment Policies 

The majority of school boards had a relatively comprehensive set of stu- 
dent evaluation policies in place. However, 12% of boards had no evaluation 
policy. This is surprising considering the great impact evaluation has on the lives 
of students and the work of teachers. A student’s final assessment is obviously 
very dependent on the evaluation received from the teachers. Teachers are equally 
affected since a significant part of their time is dedicated to student assessment. In 
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fact, research conducted by Stiggins revealed that “teachers typically spend a third 
of their professional time or more involved in assessment-related activities.” 

Approximately 88% of school boards indicated that they had assessment 
policies covering the last three years of high school. Listed below are the areas 
most commonly covered in policies. 



Some boards (10%) indicated that their polices covered other areas such as own- 
ership of examination materials, procedures for make-up tests, and information 
provided to teachers and parents. It is surprising that only 32% of boards said 
their policies covered performance/authentic evaluation, considering that many 
provinces have tried to include performance-based evaluations in many areas of 
study. 

Policy Design, Implementation, and Monitoring. Table 1 1 provides a 
breakdown of the responsibility for policy development, implementation and 
monitoring. Design and development of evaluation policies appear to be a mixed 
responsibility. Most school boards listed one of the following as being responsible 
for policy design: department/ministry of education (43.6%); school boards in 
conjunction with schools (42.9%); and school boards alone (42.9%). Some boards 
stated that responsibility for certain policies depends on the policy. For example, 
if the policy covered provincial examinations, the ministry was primarily respon- 
sible for it; if it covered school assessment issues such as reporting and promo- 
tion, it was the responsibility of the board. Other policies, such as those related to 
the choice of assessment strategies in the classroom, may be the sole responsibil- 
ity of the schools. 

Responsibility for implementing policies was also mixed. However, most 
boards listed either school boards and schools, or schools alone, as holding the re- 
sponsibility for implementing policies. Clearly, those responsible for developing 
policies do not always hold the responsibility of implementing them. 

21. R. J. Stiggins, Teacher Trainiri}’ in Assessment: Overcomin)’ the Neglect (Portland, OR: 
Northwest Regional Educalional Laboratory, 1991). 



Area Covered 



% Boards Stating Area Was Covered 



Purpose of evaluation 

Grading 

Reporting 

Promotion, retention and placement 

Methods/sources of evaluation 

Use of results 

Appeal procedures 

Domains of learning 

Extent and use of standardized testing 

Performance/authentic evaluation 



70.7 

70.7 

70.7 

69.3 

67.1 
62.9 

51.4 

42.1 
33.6 

32.1 



The school boards in conjunction with schools were most often noted 
(56%) as being responsible for monitoring policies to see if they have been imple- 
mented and understood satisfactorily. Most boards also selected more than one 
level of the educational system as being responsible for implementing and moni- 
toring policies. It appears that policies are not monitored very stringently. Forty- 
four per cent of boards stated that policies are frequently monitored. Only 32% 
said that they were strictly enforced and 20% stated that policies were only occa- 
sionally monitored. 



Table 11. Respon.sibility for the De.sign, Implementation and 
Monitoring of Evaluation Policies 



Who is Responsible ^ 


Development 
% Yes 


Implementation 
% Yes 


Monitoring 

%Yes 


Dcpl./Min. 


44 


18 


23 


Dcpl./Min. and Boards 


31 


27 


29 


Boards 


43 


41 


39 


Boards and Schools 


43 


54 


56 


Schools 


27 


54 


.50 


Other 


3 


1 


3 



^ Choices arc not mutually exclusive. Respondents could have selected more than one choice. 



School boards use a variety of methods to ensure that policies and prac- 
tices are implemented and understood at the school. Eighty-five per cent of boards 
distribute copies of policies and guidelines to the schools. Seventy-one percent 
identify in-service as a method of implementing and reviewing policies. Other 
common methods include conducting school visits (58%), assessment training 
sessions (48%) and distributing sample materials (46%). 

Related to policy implementation is the degree to w'hich professional de- 
velopment activities are offered. Eighty per cent of the boards surveyed offer pro- 
fessional development activities in assessment training. Most activities take the 
form of workshops for teachers and focus on general evaluation practices. .Sub- 
ject-based activities where evaluation is a primary focus are also popular. Other 
activities include workshops for school admini.strators and subject-based profes- 
sional development activities for teachers where student evaluation is a secondary 
focus. 

Although there seems to be a strong emphasis on development activities 
and evaluation in general, only 46% of the boards responding said there is a des- 
ignated person at their board whose primary responsibility is assessment and 
evaluation. 
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Policy Changes and Problems. A large majority of respondents stated that 
there have been recent changes in evaluation policies (67.1%) and practices 
(69.3%). The most common reasons were (a) a new ministry mandate, (b) to im- 
prove the quality of education, and (c) a desire to be more publicly accountable 
for the system. The most frequent policy changes were the introduction of new 
policies and the revision of existing ones. Other changes included a move to more 
formative evaluation and a greater emphasis on continuous assessment. For exam- 
ple, one board noted that policies have been changed to put more emphasis on on- 
going assessment since it was recognized that examinations were not the best way 
to evaluate students. Departments and boards are attempting to modify policies to 
put less emphasis on paper and pencil testing and to ensure that a broader range of 
assessment techniques are being incorporated into the classroom. 

The most cited changes in practice were an increase in the use of forma- 
tive evaluations and more varied, non-traditional methods of evaluation. One 
board even devotes a section on the students’ report cards for self-evaluation. 

(The student is asked to fill out sections on his or her dependability, enthusiasm, 
co-operation, initiative, organization and self-discipline.) A separate section asks 
the student to identify what can be done to improve his or her report. This indi- 
cates a move away from the traditional teacher evaluations and encourages the 
student to become more involved in self-assessment techniques, which may be 
used throughout the school year. 

It is interesting to note that several boards stated they are using more 
summative evaluation. This probably refers to the move toward more provincial 
examinations and the need for a mark to reflect what students know about a sub- 
ject at the end of the course. This may seem contradictory to the current move 
away from evaluations that serve purely as end-products, offering little in the way 
of feedback, especially if formative evaluation is used less frequently. - 

Only 36% of the boards identified policies that have been a particular 
problem for their schools. It would appear that despite the many recent changes in 
policies and practices, relatively few of them are causing difficulties. Two prob- 
lems that were noted by several boards included difficulties in dealing with pro- 
motions, and problems related to marking and changes in evaluation. One board 
noted that the rapid pace with which the policies were being implemented was a 
problem. It may be that boards and schools need an adjustment phase when poli- 
cies are introduced so that new philosophies and practices can be approached 
more slowly. This may reduce some of the difficulties associated with new 
changes in evaluation. 

Approximately half of the sample (51%) identified areas in which they felt 
policies should be modified. Several boards stated that policies were currently un- 
der review. Others wanted to see a continuous monitoring and updating of poli- 
cies. Many boards simply stated that existing policies needed to be modified — 
without specifying in which areas the modifications should occur. 
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Student Assessment Practices 



Although a wide range of evaluation practices are used by boards, by far 
the most common are teacher-made tests. This confirms what departmental offi- 
cials said. Table 12 shows the first, second, and third choice of evaluation method 
selected by board officials for a number of subject areas. 

For most subjects, the method of evaluation most commonly used is a 
teacher-made test. The only two subjects that did not have this listed as a first 
choice were physical education and theatre, both courses that focus on behav- 
ioural skills. These two had observation listed as the most common method of 
evaluation. 

The method of evaluation listed as a second choice depended on the 
course. Homework and projects were both listed for three courses. Teacher-made 
tests were listed as the second choice for physical education, and projects were 
listed as the third choice. The reverse was the case for theatre — projects were the 
second choice and teacher-made tests were the third choice. All subject areas still 
rely on teacher-made tests as an important method of evaluation and in most sub- 
jects it is the main method used. 

Projects and homework were commonly listed as the third method of 
evaluation. From the table it can be concluded that there are three main methods 
of evaluation used across most subjects: teacher-made tests, projects, and home- 
work. Observation is commonly used in subjects that require the students to ac- 
quire behavioural skills. It appears that the use of other less traditional methods of 
assessment, such as performance evaluation, portfolios, and daily work is still 
somewhat limited. 

Boards were asked whether they used performance-based evaluation in 
any areas of assessment and how extensively it was used. Seventy-four per cent of 
the school boards stated that they did use performance evaluation. A large number 
of boards (52%) use performance evaluation in physical education. English (49%) 
and second language (48%) were two other courses in which performance evalua- 
tion was used by a good number of boards. Forty-four per cent of boards indicated 
that it was used in science, computer studies and theatre and arts. Some 37% of 
the sample reported using performance assessments in mathematics; and only 
33% used it in social studies. 

Performance evaluations are used by 64% of the boards responding as a 
means of evaluating some course objectives. Twenty per cent indicated that it was 
a primary means of evaluation for assigning marks and 25% reported using it to 
assess objectives that are difficult to assess by more traditional forms of evalua - 
tion. Very few boards, only 10% of the sample, said they used this type of assess- 
ment as a tool for student feedback. This finding does not support the desire ex- 
pressed by many boards to move towards using more fomiative types of evalua- 
tion. Apparently authentic assessment is not viewed by many boards as a viable 
means of conducting evaluations for short-term student progress. 
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Table 12. Evaluation Methods Preferred for Selected Subjects 
(First, Second and Third Choices) 



Subject 


Preferences 


Area 


1st Choice 


2nd Choice 


3rd Choice 


Mathematics 


Teacher-made tests 
(62%) 


Homework (54%) 


Projects (17%) 


Science 


Teacher-made tests 
(63%) 


Homework (21%) 


Projects (24%) 


English 


Teacher-made tests 
(49%) 


Homework (16%) 


Projects (17%) 


Second 

Language 


Teacher-made tests 
(44%) 


Observation (13%) 


Projects (15%) 


Social 

Studies 


Teacher-made tests 
(56%) 


Projects (24% 


Homework (28%) 


Computer 

Studies 


Teacher-made tests 
(39%) 


Projects (21%) 


Homework (14%) 


Physical Ed 


Observation (35%) 


Teacher-made tests 
(19%) 


Projects (14%) 


Theatre 


Observation (24%) 


Projects (20%) 


Teacher-made 
tests (9%) 


Co-operative Ed 


Teacher -made tests 
(19%) 


Observation (14%) 


Projects (10%) 



1. A total of 140 boards responded. 

2. Methods were selected from the following: standardized tests, publisher tests, teacher-made tests, 
homework, learning journals, observation, projects, portfolios, self-evaluation, teacher -student conferences, 
assigrunents. school board exams, provincial exams, participation, daily work, laboratory work, oral exams, 
oral presentations, attendance, performance evaluations, work experience and employer interviews. 



Boards and Provincial Examinations 
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Of the 140 that responded, 1 12 boards said they have students who write 
provincial/territorial examinations. The majority of boards indicated that these ex- 
aminations are marked by either the evaluation division of the department of edu- 
cation or by a committee of teachers overseen by the department of education. 

Ten per cent of boards said that provincial examinations were marked by a com- 
mittee of teachers overseen by the school board and a further 6% have the exami- 
nations marked by an external committee of teachers and subject specialists. 

Seventy-five per cent of the boards responding submit school marks to the 
department for those students writing provincial/territorial examinations. This 
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corresponds to the proportion of those provinces conducting provincial examina- 
tions. Of the boards responding, most had a good grasp of the provincial regula- 
tions on provincial examinations. However, there were several boards that did not 
know the percentage amount of their schools’ contribution to the provincial grade 
received by students. Since Ontario, Nova Scotia and Prince Edward Island were 
not holding provincial examinations at the time the survey was conducted, most 
boards from these provinces stated that the school portion was worth 100% of the 
final mark. However, in one of the provinces with no provincial examinations, 
one board stated that the school portion was worth 50-60%. It appeared that some 
boards either misinterpreted the survey question or that these boards were unfa- 
miliar with the departmental regulations. 

Many boards are required to use specified criteria for assessing the school 
portion of a student’s mark in provincial examination courses. Forty-one per cent 
of boards stated that they do have special criteria in these cases. Depending on the 
board, the responsibility for preparing these criteria varies. Nineteen per cent of 
boards stated it was prepared by the ministry, 17% indicated that the school 
boards were responsible, 16% said the schools were responsible, and 14% said it 
was the responsibility of teachers. These responses are not mutually exclusive. 
That is, several boards selected more than one of the possible choices provided. 

Board .:iatisfactiun with Provincial Examinations 

To determine how boards felt about the current system of provincial ex- 
aminations, they were asked whether they thought there should be a system of 
provincial examinations. Sixty-nine percent of respondents felt that there should 
be a such a system. Most boards indicated that these examinations should be held 
in the core subject areas. Sixty-six per cent stated there should be a math provin- 
cial examination, 64% felt there should be one in science and 65% of respondents 
would like to see a provincial examination in English. Another 48% of boards felt 
there should be a second language examination, and 46% reported that an exami- 
nation should be held in social studies. Fifteen per cent of respondents preferred a 
provincial, examination in computer/technology studies and 12% felt an examina- 
tion should be held in co-operative/vocational education. Only 4% of respondents 
indicated that examinations should be held in physical education, theatre, and ans. 
Interestingly, the strongest opposition to a system of provincial examinations 
came from those provinces that were not holding such examinations at the time of 
the survey. 

Board Emphasis on Evaluation 

Student evaluation has a tremendous impact on the lives of students, and 
according to most research, teachers spend approximately one-third of their 
preparation and instructional time dealing with evaluation and related issues. De- 
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spite this, there were many boards — 17 in this study — that had no policies cov- 
ering high school evaluation. Furthermore, only 46% of the boards said they had 
someone at their board whose primary responsibility was evaluation. Evaluation 
was nearly always seen as a secondary rather than a primary activity of the sys- 
tem. 

There is, however, a move toward quality service and greater use of goal- 
related information in decision-making and improvement. In education, 
optimizing student performance is the primary goal of the system, and measuring 
achievement as thoroughly as possible is the only way it can move beyond medi- 
ocrity. 
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Chapter 5 



Scholarships and Student Assessment 



SCHOLARSHIPS for graduating students are granted frorri a number of sources, 
including the provinces, federal government, school boards, schools, unions, busi- 
nesses, and private individuals and foundations. These scholarships range from a 
few dollars to tens of thousands of dollars. They are a highly valued source of 
help to those who pursue post-secondary education, and, in fact, most scholar- 
ships can only be accepted if a student intends to pursue some kind of further edu- 
cation. 

Since scholarships are so closely tied to testing results, a section dealing 
directly with scholarships was added to both the ministry interviews and to the 
school board questionnaire. The purpose was to determine the primary sources of 
secondary school scholarships and awards, on what basis these are awarded, and 
what kinds of special requirements are tied to receiving them. Since this was 
somewhat of a secondary issue, the survey was not comprehensive and did not 
cover the many issues associated with scholarships. Scholarship and its link to as- 
sessment is strong, and some exploration of that link was considered useful in this 
study. 

Who Awards Scholarships? 

Table 13 shows that five jurisdictions offer a provincial scholarship pro- 
gratn; seven do not. However, as the board results show, there are a number of 
scholarship programs available in all provinces, even when the province does not 
offer them. 
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Table 13. Provincial Scholarships for Graduating Students 



Province 


Is There a 

Scholarship 

Program? 


Subject- 

based 

Awards? 


What Are the 

Award 

Criteria? 


How Is Achievement 
Measured? 


Special 

Requirements 


British 

Columbia 


Yes 


Yes 


Academic 
excellence 
by subject 
area 


Provincial 
scholarship 
examination by 
subject area; 
participation 
optional 


Canadian 
citizen: maintain 
a minimum 
overall average 
on test 


Alberta 


Yes 


No 


Overall 
acaden ic 
excellence 


Provincial 
examinations and 
school marks 
combined 


Must show 
proof of 
registration at 
a post-secondary 
institution 


Saskat- 

chewan 


Yes 


No 




School marks 
and teacher recom- 
mendation; provincial 
exam and school 
marks for selected 
subjects 


Must show 
proof of regis- 
tration at a 
post- secondary 
institution 


Manitoba 


No 


— 


— 


— 


— 


Ontario 


No 


— 


— 


— 


— 


Quebec 


Yes 


No 


Qualify for 
post-secondary 
and financial 
aid 




Must meet 
special 

financial need 
requirement 


New 

Brunswick 


No 


— 


— 


— 


— 


Nova 

Scotia 


No 


— 


— 


— 


— 


Prince 

Edward 

Island 


No 


— 


— 


— 


— 


Newfound- 
land and 
Labrador 


Yes 


Sonic 


Top academic 
achievement 
by province, 
by electoral 
district and in 
science 


Provincial 

scholarship 

examination; 

participation 

optional 




Northwest 

Tenitories 


No 


— 


— 


— 


— 


Yukon 


No 


— 


— 


— 


— 
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Criteria for Awarding Scholarships 

Three of the five provincial scholarships are awarded on the basis of over- 
all academic achievement; in one case it is offered for high subject-based achieve- 
ment, and in another it is based upon financial need. In Newfoundland and Labra- 
dor, scholarships are also offered by provincial electoral districts where the three 
top academic students in each district are awarded scholarships. The award is 
based only on achievement in the district and some of these students may have 
lower achievement scores than others who did not receive scholarships in other 
districts or on the basis of other scholarships given provincially. 



How Scholarship Eligibility is Measured 

Of the five jurisdictions awarding provincial scholarships, two use a schol- 
arship examination system, and two use the provincial examinations as the basis 
for the awards. One uses school marks and teacher recommendations. 



Special Scholarship Requirements 

To receive scholarships, students in most provinces must adhere to special 
requirements. In some cases, students being educated in the province have to 
show that they are registered at a post-secondary institution; others have to show 
that they are Canadian citizens. In yet other provinces, students must maintain an 
overall minimum average or must show that they have met graduation require- 
ments in the provincial certification system. In Quebec, students must qualify for 
a post-secondary institution and show that they have a need for financial support. 



Chapter 6 



Best Practices in 
High School Evaluation 



RECENT PRESSURES from parents, employers, and other groups with vested 
interests in the education of high school students have motivated board and de- 
partment officials to take a critical look at the evaluation policies and practices 
that are being implemented in our schools. This, in turn, has led to a flow of new 
assessment ideas and philosophies. Moves toward more comprehensive assess- 
ments, including performance-based and self-evaluations, are producing a wave 
of innovative assessment techniques. Assessment’s clear link with improved 
achievement has also resulted in a renewed provincial emphasis. 

Both provincial and school board officials were asked about their level of 
satisfaction with high school evaluation policies and practices, about what they 
felt should be changed, and whether or not some of these desired changes were 
being implemented. School boards were also asked what some of their best as- 
sessment practices were. From the interviews, questionnaires, and the materials 
(documents, policy guidelines, etc.) supplied by the respondents, a number of 
very interesting practices came to light. Without having a section to focus on 
these, this report would have missed some of the most interesting characteristics 
of evaluation in the country. 

The best practices discussed by boards fell into seven broad areas; 

\/ use of a broad range of assessment methods to ensure comprehensive 

coverage of objectives and to ensure that assessment is linked to learning 
outcomes 

\/ introduction of or improvements to provincial examinations 
^ greater use of summative evaluation to consolidate what .students have 
learned by the time a program of studies has been completed 
use of formative evaluation to improve classroom achievement 
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greater emphasis on modifying evaluation for special needs students 
^ use of perfonnance-based assessment in the classroom and in large-scale 
assessments 

^ more reporting to parents and the public 

Many boards recognized the use of a broad range of assessment tech- 
niques as one of the best approaches to evaluating students. The philosophy of re- 
lying solely on pencil and paper tests is frowned upon by most educators and al- 
though this method of evaluation is still the most commonly used, it is usually 
done in combination with other methods. School boards indicated that using a 
mixture of both formative and summative assessment techniques is the best .strat- 
egy for providing fair student evaluations. Many boards stressed that a combina- 
tion of on-going evaluations along with an end of the year common examination 
was the best approach. 

Many boards also identified provincial examinations as a “best practice.” 
Apparently, the move to re-introduce provincial examinations in recent years has 
been favourably received. Many boards feel that a system of comprehensive year- 
end examinations is critical in providing a thorough student assessment, and in in- 
forming the public about student graduation performance. It is important to note, 
however, that most boards stated that final examinations should be used only in 
conjunction with a broad range of other daily a.vsessment strategies that recognize 
a student’s efforts throughout the school year. In fact, all jurisdictions follow a 
practice of shared evaluation that recognizes the importance of daily clas.sroom 
assessments as well as year-end summative evaluations. 

Another common position is that there is, in fact, no best practice. Many 
boards stated that evaluations should be based on the type of course material be- 
ing taught and that no one method of evaluation was suitable to all subjects. 

Again, boards often expressed a desire to see a variety of evaluation techniques 
used across all subject areas. 

The practice of modifying assessment strategies to provide better evalua- 
tions for special needs students is a further example of tailoring assessments to 
.specific purposes. Although boards recognize the need for uniform and consistent 
evaluations, they also note that policies must not exclude those students who have 
needs that cannot be met by the mainstream evaluation practices. Where there is 
evidence that students have achieved learning objectives, but, for special rea.sons, 
cannot show their achievement through practices used by the majority of students, 
alternative methods of evaluation are used. 

More and more, schools are relying on performance-based a.ssessments to 
evaluate both individual student achievement as well as the overall effectiveness 
of certain programs. .A student’s final mark is rarely the result of the total of 
marks received on selected tests. Grades are often partially based on group discus- 
.sions, one-on-one observations, or other activities such as oral interviews or pres- 
entations. Teachers are also including grades on portfolios, learning journals and 
other writing samples as a component of a student’s final evaluation. Even chap- 
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ter tests and provincial examinations are being refined in many cases to include a 
written component and are relying less on multiple-choice items. 

Some boards allov/ students themselves to become more active in the 
evaluation process by promoting self-evaluations and peer evaluations. Through 
this process, students become aware of the essential considerations involved in 
any assessment. This provides them with valuable feedback, which may be used 
as a self-assessment tool throughout the school year. 

Several boards have adopted evaluation policies that specifically include 
accountability to parents, students, and employers as an integral component of 
student evaluation. The reporting of student progress has been modified by many 
boards so that parents and students are better and more frequently informed. Re- 
port cards may even include room for students to comment on their progress and 
to make suggestions for improvement. 

Many boards included samples of their evaluation work with their ques- 
tionnaire responses: policy documents, reporting and grading guidelines, and a va- 
riety of other evaluation materials. Most information referred to assessment be- 
liefs, methods of evaluation, exam schedules, and the use of assessment results. 
Occasionally, however, interesting information pamphlets and guides were re- 
ceived. One of these was A Guide for Teacher Reflection, an information folder 
on student evaluation that encouraged the teacher to think about, and discuss with 
colleagues, a number of questions about student assessment practices. These ques- 
tions focused on issues such as the u.se of assessments, methods of evaluation, and 
reporting techniques linked with student learning styles, etc. (A copy of the centre 
part of the folder is included in Appendix C.) Another board sent along a very 
brief and easy to read set of guiding principles for student evaluation suitable for 
both parents and educators. A different approach to policy was found in part of 
one board’s documentation on evaluation. The intentions for student evaluation 
were framed as ’’goals” accompanied by a list of specific objectives to be obtained 
in the evaluation proce.ss. (See Appendix C.) 

As well as the materials fiom boards, documents were also sent by many 
provincial ministries. Quebec and British Columbia, for example, provided mate- 
rials showing significant and ground-breaking work done in the classroom as well 
as in large-scale assessment. 
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Chapter 7 



Looking Forward 



IF THE RESPONSES of ministries/departments and school boards retlect any- 
thing about the future of evaluation, it is likely to remain a healthy part of the 
education agenda for some time to come. It appears that high school provincial 
examinations could be back in all provinces in the near future. About a year ago, 
Ontario released its Royal Commission report For the Love of Learning, recom- 
mending sweeping changes in the area of provincial testing. The two Atlantic 
provinces without examinations are now collaborating in a common curriculum- 
common assessment enterprise. Likewi.se there is a Canada-wide common .science 
curriculum initiative under way through the Cotincil of Ministers of Education, 
Canada. These types of effons will make it difficult to resist the tide toward 
common examinations or assessments, especially since participating provinces 
will have to share in the work related to the.se initiatives. 

The general commitment to a greater emphasis on a.sses.snients, occasionally 
tempered by concerns about the political and .societal influences, is driving the 
decisions about asses.sment. Inherent in the di.scussions and written elaborations 
were a number of comments related to factors that tend to shape the thinking of 
both ministry and board policy and practice. Respondents were very much aware 
of these influences and their implications on educational policy in evaluation. 
Noted among these w'cre the pre.sent fiscal climate, which demands proof of 
quality and perfomiance for dollars spent, the need for Canada's education sys- 
tems to be internationally competitive, the extensive public demand for perfomv 
ance and accountability, the need to improve student achievement in Canada, the 
need to make as.sessment relevant to the needs of the classroom teacher, and, of 
course, the issues surrounding reliability of large-.scalc a.s.scssment results for 
high-stake pnrpo.ses such as promotion, selection, and certification. 
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It was also evident that'most provinces were attempting to ensure that the 
policies and practices at the ministries and departments were comprehensive 
enough to respond to these issues and concerns, and boards were concerned that 
they support a strong learning culture by ensuring that their plans and priorities 
reflected exemplary practice and policy. Often, however, there were concerns and 
questions about what constituted exemplary practice and policy. Some felt that 
developing common assessment and examinations at the national or regional level 
would encourage higher standards, others felt this was counterproductive; some 
felt that the use of comprehensive examinations that covered expected learning 
outcomes from several grades or levels of schooling would encourage ongoing 
review and hence improve learning; others felt this was unfair to students and 
would create limitations in scheduling programs. Some felt that performance- 
based assessment should form a major part of all large-scale assessments, while 
others felt that this was an unnecessary and inefficient use of resources when 
paper and pencil testing, especially in higher grades, is one of the most reliable 
methods of assessing cognitive learning. And finally, some felt that assessment is 
generally too curriculum-specific and should focus more on what society and the 
workplace expect of an educated person; others felt that this approach would not 
be in the best interests of students, since teachers were expected to teach primarily 
what was in the curriculum. 

Reflecting on the interviews and the responses to the questionnaires, one 
can see that both boards and ministries are putting more emphasis on the develop- 
ment of comprehensive policies to cover all aspects of student evaluation. The 
ministries are becoming involved in developing policies and guidelines for the 
conduct of classroom assessment, a rather nev,' phenomenon. Some of the material 
sent to the researchers from other provinces showed that much effort had been put 
into this work. The boards, many of whom had gone far beyond the work done by 
ministries, had taken their efforts down to a degree of detail that could be of use 
to teachers in their day-to-day work in the classroom. 

In spite of the concerns raised, the connection between assessment and im- 
provement of the quality of education appears to be firmly established in the 
minds of most educators. The only real hesitancy they had was related to their 
concern that pushing ahead too quickly might compromise the quality of the in- 
struments and methods used. Respondents to the study clearly indicated that they 
wanted evaluation to be comprehensive enough to measure the full range of 
knowledge and skills covered in the curriculum deemed to be important to the in- 
dividual and to society. There was clear evidence that educators wanted to see as- 
sessment move beyond paper and pencil testing to include, where necessary, per- 
formance-based assessments. 

Although the relationships between assessment, standards, and account- 
ability are understood and accepted, there is a clear message that the best interests 
of the students must always be kept in mind when designing, administering, 
analyzing, and using the results of any evaluation. 
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Appendix A 



DEPARTMENTS/MINISTRIES— TELEPHONE INTERVIEW 



ATTN: DIRECTORS OF STUDENT ASSESSMENT 
CANADIAN PROVINCES/TERRITORIES 



This interview is being conducted on behalf of the Canadian Education Association (CEA). The 
CEA is interested in investigating both the techniques used to evaluate high school students across 
Canada and the policies which guide these practices. This review only pertains to those students 
who are in the final three years of the high school program. The information obtained from the 
present interview and from a questionnaire to school district superintcndcnts/directors across the 
country will be documented in the final report. That final report will provide an overview of what 
is happening in assessment during the last three years of high school and will provide some insight 
into the best assessment practices currently available to Canadian teachers. 

It is asked that you review the interview questions and, if necessary, pass them on to the person in 
your department/ministry who is in the best position to supply the information required. In order to 
decrease the actual interview time necessary, it is asked that the contact person respond to the 
questions and fax us these responses. (Please retain a copy for interview purposes). Within the 
following few days that person will be contacted by telephone to discuss and verify the information 
given. 

Please note that the person selected for the interview should be someone who is very familiar with 
the policies and practices of student evaluation in your province or territory. 



PLEASE FAX THE NAME AND PHONE NUMRER OF THE CONTACT PERSON TO RE 
INTERVIEWED TO DANA SPURRELL 709-729-3669 (FAX), A FAX SHEET IS ATTACHED, 



Lenora Perry Fagan 
Telephone: 709-729-3(XK) 
& Dana Spurrell 
Teleph.me: 709-729-1390 



Department of Education 
Newfoundland and Labrador 



55 




ERIC 






DEPARTMENTS/MINISTRIES — TELEPHONE INTERVIEW 



1 . Provincc/Tcrrilory 

Name of Contact 

Position 

2. Within your province, whodcsignsand imple- 
ments the policies regarding student evaluation 
in the final three years of high schex)!? 



If this is done by the school boards, docs the 
Department/Ministry play any role? Please 
specify. 



3. Have there been any major changes rccc.itly 
(past 10 years) in the policies, guidelines or 
practices regarding student assessment? 

YES NO 

If yes, please explain the changes made. 



What were the reasons for these changes? 



When did these changes uikc place? 



4. Arc the school boards at liberty to modify or 
alter these policies in any way to meet the needs 
of their schools? 

YES NO 

5. Arc there methods for ensuring that the |X)li- 
cics. practices or guidelines arc implcntcntcd and 
understood at the district and sch(X)l level? 

YES NO 

Specify 



6. Do you have provincial examinations for high 
school certification/ graduation? 

YES_ NO (lfno,goio#ll) 



If yes, in what subject areas? 

Literature Earth Science 

Language Geology 

Sec. Lang. Biology 

Computer Stud. Geography 

Mathematics World Prob. 

Physics History 

Chemistry Art 

Others: 



7. Who is responsible for preparing provincial 
examinations? 



How arc die provincial examinations prepared? 
(i.c., What is the development process?) 



8. Do your graduation level provincial exami- 
nations cover information from al 1 three grades of 
the course (where appl icablc) or arc the exam ina- 
tions based solely on the material for the final 
level course? For example, with courses such as 
math, which iirc usually taught at each level 
(grades 10, 1 1, 12), would the examination cover 
material taught in all three grades or just that 
taught in the upper level (grade 12)? 

(a) Examinations only cover the material taught 
in die final level 

(b) Some examinations cover material from all 
three levels 

Please specify the courses 



9. What percentage of a student’s final mark is 
based on: 

Provincial examinations 

Sch(X)i evaluations 

10. Can regular strciim students graduate without 
doing selected provincial examinations? 

YES_ NO 



If yes, on whal basis? 

(a) Certificate issued by school 

(b) Standardized test scores (other than provin- 
cial examinations) 

(c) Recommendation of teacher(s) and certificate 
issued by deparlmeni/ministry 

(d) Other, please specify 



1 1 . What is your policy regarding special educa- 
tion students who are of school-leaving age? 

(a) “Graduate” with certificate issued by school if 
objectives of specialized instruction arc met 

(b) “Graduate” with certificate issued by depart- 
ment/ministry if objectives of specialized in- 
struction are met 

(c) Graduate only if graduation qualifications of 
provincially mandated courses arc met 

(d) No current policy in place 

(c) Other 

Please specify. 



14. Do you use perfonnance (authentic) evalua 
tion in any areas of assessment? 

YES NO 

If yes, in which subject areas? 



How extensively is this done? 

(a) Used as primary means of evaluation 

(b) Criterion for completion of course objectives 

(c) Pan of course objectives but not necessary for 
course completion 

(d) Used as a tool for student feedback only 
(c) Other, please specify 



15. Who issues high school diplomas/ccriifi- 
cates? 

(a) Provincial dcpartmcnl/minislry of education 

(b) District school board 

(c) School 

16. What is considered a passing grade? 



12. Over the past ten years, a great deal of public 
discussion has taken place on the level of skills 
and knowledge achieved by graduating students. 
Do you feel the standards being achieved t ;* 
graduating students have declined, remained the 
same, or have increased for the following subject 
areas: 

Declined Remained Incrcitscd 





Same ! 


Math 




1 


Language 






Literature 






Second Lang 




j „ 


Sciences 




i * 

r 4 


Social Studies 


j 


Computer Stud. 




Theatre & Arts 




Physical Ed. 




Others: 





1 3. In your opinion, what arc the most commonl y 
used methods to evaluate the school iX)rtion of a 
student’s mark? 



17. What Ibnn of grading or reporting is most 
commonly used in your province? 

(a) Letter grades 

(b) Numeric grades 

(c) Other, please specify 



1 8. Arc any mcxiifications (statistical adjustments, 
scaling, etc.) made at the provincial level to: 

(a) School marks 

(b) Provincial examination marks 

(c) Combined (school and provincial) marks 

Please spa'ify. 



19 A. Do you have assessments at the high school 
level for program evaluation or system evalua- 
tion purposes (e.g.. criterion referenced or norm- 
referenced tests)? 

YES NO 

Explain. 
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B, For program evaluations, arc all students as- (c) Somewhat satisfied 

sessed or a sample of students ? (d) Somewhat dissatisfied 

(c) Dissatisfied 

If a sample is selected, what is the selection (0 Very dissatisfied 
procedure? 

Where would you like to make changes in the 
current policies and practices, if any? 



20. Doeslhcdcpartmcni/ministryofcducationin 
your province offer scholarships to graduating 
students? 

YES NO (If no. go to #23) 

If yes, are these scholarships specific to a particu- 
lar field of study? 

YES NO 

Please specify. 



2 1 . How arc recipients selected for these scholar- 
ships? 

(a) Scholarship examination 

(b) School marks and mark on scholarsh ip exam i- 
nation 

(c) School marks and recommendation of 
lcachcr(s) 

(d) School marks only 

(c) Provincial examination marks on sclccicd 
subjects 

(f) Provincial examination marks and school 
marks combined on selected subjects 

(g) Other, please specify 



If students write a scholarship examination, is 

this examination optional 

or compulsory ? 

22, Arc there any special requirements that the 
candidate needs to fulfil in order to receive the 
scholarship? 

YES NO 



Please specify. 



23. To what cxieni arc you satisfied with assess- 
ment policies and practices in your province? 

(a) Very satisfied 

(b) Satisfied 



Arc any of these modifications in the process of 
being implemented? 

YES NO 

Specify. 



24. How many students arc enrolled the last three 
years of high school in your province? 

Public Native 

Private 

Institutional (Specialized) Schools 

25. How many schools in the province offer a 
high school program? 

Public Native 

Private 

Institutional (Specialized) Schools . 



SUBMIT: 

Please submit any documents that specify the 
guidelines, policies, etc., regarding: 

(a) assessment 

(b) grading 

(c) reporting of gradcs/asscssments 

(d) promotion 



PLKASK COMPLKTK AND FAX TO: 

DANA SPURRKLL, 

DKPARTMKNT OF EDUCATION 
NEWFOUNDLAND 709-729-3669 

PROVINCmKRRlTORY 

roNTAC'r PERSON 

iH)srnoN 

TKtKPHONK 

MAIUKR 

FAX M MItKR 
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Appendix B 



TO SCHOOL BOARDS 

QUESTIONNAIRE ON THE EVALUATION OF CANADIAN STUDENTS 
IN THE LAST THREE YEARS OF HIGH SCHOOL 



Please complete the following questions as thoroughly as possible. Ensure that all applicable 
questions are answered by checking the boxes provided in the right-hand margin 



1. Sch(X)I Board 

Province/Territory 

Name of Contact 

Position 

2. Do you have student evaluation/assessment 
policies covering the last three years of high 
school? (O 

If yes, what areas of student evaluation are 
covered in the policies? Please check all that 
apply. (✓) 

(a) Purpose of evaluation 

(b) The use of results obtained from evalua 
tions 

(c) Methods or sources of evaluation 

(d) The domains of learning (affective, 
psychomotor, cognitive) 

(e) Grading 
(0 Reporting 

(g) Promotion, retention and placement of 
students 

(h) Performance/authentic evaluation 

(i) ApfXJal procedures 

(j) Extent and use of standardized testing 

(k) Other. Please specify. 

3. Who is responsible for developing, imple- 
menting and monitoring these policies? (✓) 

(a) Departmcni/Ministry of Education 

(b) Department/MinisU'y of Education in 
conjunction with the school boards 

(c) Individual school boards 

(d) Individual sch(X)l boards and their 
schools 

(e) Individual schools 

(0 Other. Please specify. 

4. To what degree lue tliesc policies enforced 
at the school level? (✓) 



(a) Su*ictly enforced 

(b) Frequently monitored 

(c) Occasionally monitored 

(d) Not at all enforced 

5. Have there been any recent changes (past 10 
years) in the assessment policies or practices of 
your board? 

(a) Policies: (O 

If yes, please specify tlie changes made. 

(b) Practices: (O 

If yes, please specify the changes made. 



When and why were these changes made? 



6. Have there been any policies which have 
been particularly a problem for your scIkh)Is? 
If yes, please specify. 



7. What do you feel arc the best assessment 
practices for your schools (in terms of evalua- 
tion for the final three years of high sch(X)l)? 



8. Do you feel the existing |x>licics should be 
modified in any way? (^) 

Please explain. 

9. What methods docs your sdux)! board nave 
for ensuring that the policies and practices arc 
mildcmcntcd and undcrsuXKl at the school 
level? (✓) 

(a) Distribution of |»licies, guidelines and 
documents to all schtxds 



(b) Distribution of model examinations and (a) English 

sample assessment materials (b) Second Languages 

(c) School visits (c) Mathematics 

(d) In-service/Profcssional development (d) Science 

(e) Assessment training sessions (through (e) Computer Studies 

teachers’ centre, universities, etc.) (0 Social Studies 

(0 Other (g) Theatre and Arts 

(h) Physical Education 



10. Does your school board offer any profes- 
sional development activities in the area of 
assessment training? (✓) 

If yes, what is the nature (organization) of 
these professional development activities? 
Please check all that apply. (✓) 

(a) Workshops designed for school board 
adminisuators focusing on gc ;ral evalua- 
tion practices 

(b) Workshops focusing on general evalua- 
tion practices for teachers 

(c) Subject-based professional development 
activities for teachers with student evalua- 
tion as a primary focus 

(d) Subject-based professional development 
activities for teachers with student evalua- 
tion as a secondary focus 

(e) Other. Please specify. 

1 1 . Is there a designated person at your school 
board office whose primary responsibility is 
assessment and evaluation? (✓) 

12. Please indicate the three methods of 
evaluation (standardized tests, publisher tests, 
teacher-made tests, homework, learning 
journals, observation, projects, portfolios, self- 
evaluation, teacher-student conferences, etc.) 
most commonly used in assigning marks in the 
following subject areas: 

(a) Math 

(b) Science 

(c) English 

(d) Second Language 

(e) Social Studies 

(0 Computer/Technology Studies 

(g) Physical Education 

(h) Theatre and Arts 

(i) Co-opcrative/V(Kational Education 

13. Do you use ix'rformance (authentic) 
evaluation in any aretts of assessment? (✓) 

If yes, in which subject areas? (O 



Others: 

How extensively is this performance evaluation 
done? (•/) 

(a) Used as a primary means for assigning 
marks 

(b) Used to evaluate some course objectives 

(c) Used primarily for objectives that are 
difficult to measure in other ways 

(d) Used as a tool for student feedback only 

(e) Ollier. Please specify. 

14. Do you have students who write provincial/ 
territorial examinations? 

If yes, who marks these examinations? (•/) 

(a) The evaluation division at the Depart- 
meni/Ministry of Education 

(b) A committee of teachers overseen by the 
deparunent 

(c) A committee of teachers overseen by the 
school board 

(d) An external committee of teachers and 
subject specialists 

(e) Other. Please specify. 

15. Docs the school submit a mark to the 
provincial Department/Ministry of Education 
for students writing provincial/tcrritorial/ 
examinations? (Y) 

16. How much is the school portion of a 
student’s mark worth? 

17. Do you have special criteria for evaluating 
the school portion of a student’s mark for 
courses which have provincial/territorial 
examinations. {%/) 

If yes, who prepares these criteria? (•/) 

(a) Dcpanmcni/Ministry of Education 

(b) School boards 

(c) Schools 

(d) Teachers 
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18. Do you feci that provinces/ierrilorics 
should have a system of provincial/lerrilorial 
examinations for high school certification 
purposes? 

If yes, in which subject areas should these 
examinations be administered? (%/) 

(a) Math 

(b) Science 

(c) English 

(d) Second Language 

(e) Social Studies 

(f) Computer/Technology Studies 

(g) Physical Education 

(h) Theatre and Arts 

(i) Co-operative/Vocational Education 

(j) Other. Please specify. 

19. Docs your school board offer scholarships 
to graduating students? (%/) 

If yes, who provides funding for these scholar- 
ships? 

(a) Departmeni/Ministry of Education 

(b) School board 

(c) Schools 

(d) Other. Please specify. 

20. How are recipients selected for these 
scholarships? (i/) 

(a) Scholarship examination 

(b) School marks and marks on scholarship 
examination 

(c) School marks and the recommendation 
of teachers 

(d) School marks only 

(e) Provincial/territorial examination marks 
on selected subjects 

(0 Provincial/territorial examination marks 
and school marks combined on selected 
subjects 

(g) Other. Please specify. 



21 . Arc there any special requirements that the 
candidate must meet before receiving the 
scholarship? (%/) 

If yes, please check any that apply from the 
following list. 

(a) Must show proof of registration/admis- 
sion at a post-secondary institution 

(b) Must be a Canadian citizen or permanent 
resident 

(c) Must pursue studies within the area for 
which the scholarship was awarded 

(d) Other. Please specify. 

22. Which of the following would you use to 
classify your district? (%/) 

(a) Primarily rural 

(b) Primarily urban 

(c) Equal combination of rural/urban 

23. How many students arc there in the last 
three years of high school in your school 
district? 

24. How many schools in your district offer a 
high school program? 

NOTE: 

Please submit any documents that specify the 
guidelines, policies, etc., regarding: 

(a) assessment 

(b) grading 

(c) reporting of gradcs/asscssmenLs 

(d) promotion/rctention 

Please return completed questionnaire to: 

Ms. Dana Spurrcll 

Evaluation, Research, and Planning Division 

Department of Education 

Government of Newfoundland and Labrador 

P.O. Box 8700, St. John’s, NF AIB 4J6 

Fax: (709) 729-3669 

by August 8, 1994. 
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Appendix C 

Saskatoon (West) School Division Policy Code: HG-1 

Category: Curriculum and Instruction 



Student Evaluation 

The Board of Education of the Saskatoon (West) School Division No. 42 endorses the 
belief that student evaluation is a systematic process of assessing student progress towards sets of 
planned and developmentally appropriate objectives which reflect the growth of the whole indi- 
vidual. Further, the Board of Education believes that effective evaluation is characterized by the 
quality, quantity, and variety of feedback to students and parents regarding individual progress. 

Accordingly, the Board of Education accepts the following goals and objectives which will 
serve as guidelines as the Division develops a systematic process of assessing and reporting 
student progress within the educational curricula to facilitate the development of the whole 
student. 
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Saskatoon (West) School Division Policy 



GOALS 

1 . A wide range of evalualion 
methods will be used. 



OBJECTIVES 

1 . Formal methods will be used to assess student progress. Examples 
of formal methods are teacher-developed tests and examinations, 
commercially developed evaluation instruments and standardized 
tests. 



2. Informal methods will be used to assess student progress. Exam- 
ples of informal methods arc teacher observation, anecdotal 
records, performance appraisals, peer appraisal, and self-appraisal. 



3. Professional development opportunities and support will be 

provided to teachers to assist in expanding and enhancing evalua- 
lion methods. 



2 . 



4. 



The purpose of evaluation is 
to promote student growth 
and development in the 
cognitive, affective, and 
psychomolor domains. 



1 . 



2 . 



Standardized tests will be used in accordance with divisional 
pt)licy. (Policy to be developed.) 



Teachers will incoriwralc evaluative activities that will assess 
affective and psychomolor objectives as well as cognitive objec- 
tives. 

Student growth in the cognitive, affective, and psychomolor 
domains should be reported to students and parents. 



3. Evalualion is primarily formative in clcmcniJiry and middle years. 



4. A list of the major competencies will be developed at each grade 
level in each area of learning as resources are available. 



5 . Retention at the K-8 level will (x:cur only as part of a carefully 
designed development plan for an individual student. (Promotion 
and retention policy to be developed.) 
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3. Evaluation practices will be 1 . Teachers will provide cvalualbn plans to ihc sludcnls/parcnts as part 
fair and equitable. of the course outline. 

2. Students must know on what basis and when they will be. evaluated. 

3. In-scr\'ice will Ixj provided. Teachers will be familiarized with the 
principles and practices of fair student assessment. 

4. Parents and students will be made aware of the divisional appeals 
policy (to 1)0 developed). 



4. 



5. 



The results of evaluation 
will be regularly communi- 
cated to students and 
parents. 



1 . 

2 . 



4. 

5. 



6 . 



5. 



7. 



Evaluation will be continu- 
ous and carefully planned to 
rcflccl instructional 
techniques and cuiricular 
objectives. 



1 . 

2 . 



3. 



6 . Evaluatiov. will be a major i . 

focus of pro^'essional 
development activities at 
llic divisional level and 2 . 

school levels for 3-5 years, j 

beginning in Uic 1993-94 I 

school year. 3 . 



Each school will develop a process to annually monitor its evalua- 
tion plan and practices. 

Mechanisms for rcjwriing student programs will be developed which 
arc appropriate for the needs of the various school populations. 

Student progress will be formally rcpt)rlcd to parents at least twice 
per semester at !hc high school level and at least four limes per year 
at other levels. The report can be a documented conference, a report 
card, or both. 

School staffs will work towards increasing ilie informal reporting 
process. 

Students should be active participants in the reporting process. 



A commiucc will be fonned to study allemaiivcs to the existing 
grading siruciurc Jind current rejwri cards. 

Any changes in the grading structure or report cards will be clearly 
communicated to parents and students. 

School staffs will develop a plan to communicate the results of all 
major tests, assignments, etc., to parents 



Teachers and administrators will seek to match evaluation devices to 
inslruciional techniques. 

Final comprehensive cxaminaiiorLS based on at least 50% of the 
course content will be utilized in grades 9 to 12. unless precluded by 
subject conieni. The mark for the tomprehensive examination 
should not represent more than 40% of the final mark. 

Evaluation devices should he weighted to reflect the relative 
importance of the curricular objectives. 



In-service sessions will be provided to ensure all teachers knov/ and 
understand the di\isional evaluation tx>licy. 

Additional in services will be ])rovidcd to build on iind enhance the 
strengths of teachers in the area of evaluation. 

(^ix)rt unities vdil be provided for teachers to collaboraiivcly plan 
and implement new evaluation devices a.> ./oi strategies. 



Date approved: Jul^v 8* 1993 Reprinted with the permission of Saskatoon West School Division 
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NORTH YORK BOARD OF EDUCATION 



TEACHER INTERVIEW GUIDE: 

STUDENT EVALUATION PRACTICES 

What follows is an interview guide which can be used in several ways: 

as the basis of a dialogue between principals and teachers regarding a school’s approach to 
evaluation 

as the basis of dialogue for teachers undertaking a Supervision for Growth project focused on their 
student evaluation practices 

as a basis for reflection by an individual teacher who wants to assess her/his student evaluation 
practices 

An overview of the nature and extent of evaluation practices in the school is the first step for principals 
and teachers as they examine their school’s approach to student evaluation, The interview guide will 
enable both principals and teachers to gain an overall impression of a teacher as evaluator of student 
performance. 

This guiding questionnaire is based on areas identified in the North York statement about student 
evaluation. The indicators listed under each question can be used to exemplify the question should 
clarification be required or as probes to elicit further information. 

Principals and teachers are asked to send summaries of their interview responses to the Research & 
Evaluation Advisory Committee. Nolonly will this providean overview of evaluation practiccsacross 
the system which will help to shape North York’s policy on student evaluation, but may identify unique 
approaches which can be shared with all teachers, 



1) What do you use evaluation for? 
diagnosis 

gathering information on progress/ 
achievement 

providing feedback about your 
teaching (resources, mctliods, 
management strategies) 



providing feedback to parents and to students 
as a means of student motivation and/or 
control 

other comments 



2) What areas of learning objectives do you assess and what weight do you give to 
each? Are students involved in the setting of learning objectives and, if so, how? 



skills and knowledge taught in class 
problem solving and investigational 
skills, application of skills and 
knowledge to new material, 
organizational skills 



effort, commitment to continued learning, 
self-confidence to learn in spite of difficulty 
of task 

social skills, co-operation, leadership 
other comments 



3 ) 
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What methods do you use to evaluate students and when? 

observation standardized tests (norm orcriterion- 

intervicws/conrcrcncing referenced) 

seminars student seir-cvaluation 

classroom, teacher-set 
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icsts/exams 

assignments, projects, essays, 
presentations 

performance checklist (arts, technical, 
sports, science) 



How do you record what you find? 
anecdotal records 
portfolios of student work 
tracking sheet for (a) students 
(b) teachers 

Are you explicit about both the 
which you will use? If so, how? 
share with students what is to be 
done and how it will be assessed 
at the beginning of the term/ 
week/assignment 
set up a “contract” 

How do your evaluation methods allow for the preferred learning styles of stu- 
dents? 

verbal, visjal, kinesthetic 4M AT categories (innovative, analytic, corn- 

independent, small group, monscnsical, and dynamic) 

large group field dcpcndcnl/indcpcndcnt 

other comments 

How do you adjust your evaluation methods for students who are learning English 

as a second language or who have one or more identified exceptionalityiies)? 

more time on tests anecdotal comment on progress 

modify test or assignment postpone evaluative mark 

assess comprehension of material or comment 

using translator/allow students to other comments 

type on computer rather than handwritc 

How do you prepare your students for the various evaluation activities (e.g., tests, 
presentations, peer evaluation)? 

What kind of feedback do your students give you about the various evaluative 
methods you use? 

preferences, dislikes other comments 

effect on student self-concept 

How candid are you in communicating what you know ab(»ut a student to student 
and parent? 

relate back to methods used and records kept 

What additional things would you like to mention about your evaluation practices? 

How can North York he most helpful to teachers in the area of evaluation? 
Reprinted with the permission of the North York Board of Education 



learning objectives and the evaluative methods 

discuss “fairness” 
examine any possible bias in 
your evaluation criteria and counteract it 
other comments 



peer evaluation 
group evaluation 
feedback from parents 
feedback from other staff 
other comments 



grades book 

video oi audio tapes, photographs 
other comments 



SCARBOROUGH BOARD OF EDUCATION 
GUIDING PRINCIPLES 

RATIONALE 



Sludcni evaluation is one of Uic most imporuini and controversial aspects of both the educator’s 
role and the tcaching/lcaming pr(x:css. It is imperative that educators use effective student 
evaluation practices. To foster the professional growth of educators in the area of student evalua- 
tion, the Scarborough Board of Education is committed to offering and supporting staff develop- 
ment programs. 

Tins booklet is not prescriptive. Rather, it provides all Scjirborough personnel with expectations, 
general principles, and features of student evaluation wiili which educators should be familiar. 
This document consolidates and summarizes information that is already available in existing 
Ministry and Board publications and in documents from other jurisdictions. 



PRINCIPLES OF STUDENT EVALUATION 

✓ Student evaluation should be used for a number of purposes. 

The purposes of sludcni evaluation should be undcrsiocxl by the evaluator and by 
those being evaluated. 

^ The purposes of siudcni evaluation should be communicated to, and understood by, 
parenLs/guardians and sludcnis. 

The standards used for interpreting student evaluation results should be consistent with 
the purposes of the evaluation procedure. 

✓ Student evaluation pr(x:edures should be consistent with the purpose of the evaluation, 

✓ Student evaluation pr(x:edurcs should be varied. 

✓ More than one evaluation method should be used to ensure comprehensive and 
consistent indicators of sludcni performance, i.c., to increase reliability. 

Evaluation practices should be keyed to valued outcomes. 

✓ How evaluative Judgements arc made depends on the reference point that is uscxl. 
Evaluation approaches should measure the underlying learning that they arc intended to 
represent, i.c., they should be valid. 

✓ Evaluation should (x;cur throughout the iciiching/lcarning pr(x:css. 

✓ Student evaluation should mciisurc the prcx:css of arriving at the product as Vv'cll as the 
product itself. 

✓ Individual sclf-csiccm should be a foremost consideration in the evaluation process. 

✓ Evaluation methods should take inio account the cultural and ethnic background and the 
prior experiences of students. 

ESTABLISHINi; STANDARDS 



✓ How evaluative judgements are made depends on the reference point that is uscrl. 

^ The standards used for interpreting sludent evaluation results should be consistent 
with the pun>osesof the evaluation prcKcdure. 

In order for valid inlcq)rcUitions and judgements to Ik made about student performance, informa- 
tion from student evaluation proc'cdures must l>c compared with some kind of reference tx)ini or 
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standard. Educators use three different kinds of reference points or standards for different pur- 
poses. All of them are legitimate, and each can be used independently or in combination with the 
others. 

Criterion-referenced standard 

evaluation in relation to a student’s success in meeting slated objectives, outcomes, expecta- 
tions or benchmarks. 

Norm-referenced standard 

evaluation in relation to other students within the class or across classcs/schools/scgmcnt of a 
population. 

Self-ref ere need standard 

evaluation in relation to a student’s own performance at different points in time. 

EVALUATE: WHY? 

PURPOSES OF STUDENT EVALUATION 



Student evaluation should be used for a number of purposes. 

^ The purposes of student evaluation should be undersux)d by the evaluator and by those 
being evaluated. 

Communicate with parents 

Student evaluation provides significant information about student progress to be communi- 
cated to parents/guardians so that they may understand their child’s performance in school. 
Communicate with students 

Student evaluation should provide constructive information that assists students in identifying 
their strengths and weaknesses, nurtures their self-esteem, and helps them improve their 
performance. 

Develop self-evaluating individuals 

An overall aim of student evaluation is to produce individuals who realistically evaluate 
themselves and their actions. 

Diagnose 

The results of diagnostic evaluation enable teachers to identify specific student needs. 
Evaluate Formatively 

Ongoing measurement of student performance is used to provide direction for improvement 
and adjustment to a program for individual students and for the whole class. 

Evaluate Summathely 

Student performance is measured at the end of a unit or pericxl of time to make judgements 
about an individual student’s success in the program. In addition, summalivc evaluation 
measures the extent to which a group of students is mastering the content, concepts, and 
skills, and developing the attitudes emhedded in the curreiulum. 

Motivate 

The process, product and feedback from student evaluation can encourage students and 
enhance self-esteem. 

Place, promote, certify 

Student evaluation is a significant component of the function of schools in the areas of student 
placement, promotion and certification. 



EVALUATE: WHAT? 
EVALUATING WHAT WE VALUE 



Evaluation practices should be keyed to valued outcomes. 



✓ Evaluation approaches should measure the underlying learning that they are intended to 
represent; i.e., they should be valid. 

✓ Student evaluation should measure the process of arriving at the product as well as the 
product itself. 

The Ministry of Education defines curriculum as “all learning experiences that arc provided for 
students under the auspices of the school and the school board” (OSIS, revised 1989, 5.17). Thus 
schools are expected to provide wide-ranging programs and experiences which touch many 
aspects of the students’ lives. Whatever is important enough to teach is important enough to 
evaluate. Hence the evaluation practices of schools must reflect a many-faceted curriculum. The 
outcomes schools evaluate and the way schools evaluate them arc the ultimate statements of what 
educators value in the curriculum. 

During the past two decades, educational goals have promoted a broad range of outcomes and a 
variety of educational achievements. Educators and researchers have become knowledgeable 
about, and have demonstrated the importance of, such things as learning styles, brain theories, 
developmental stages, and multiple intelligences. This knowledge contributes to the continual 
reshaping of what and how educators teach. The recent emphasis on cooperative group learning, 
for instance, indicates that when expected outcomes change, so too must teaching and evaluation 
methods. 

As society changes, what schools value will change; as more knowledge is gained about learning 
and evaluation processes, teaching and evaluation practices must change. Because evaluation 
practices tend to shape curriculum, educators must define what they value in the learning opportu- 
nities they provide, then assess those valued outcomes with appropriate techniques. 



EVALUATE: HOW? 

VARIETIES OF STUDENT EVALUATION 



^ Student evaluation procedures should be varied. 

^ Student evaluation procedure:* should be consistent with the purpose of the evaluation. 

✓ More than one evaluation method should be used to ensure comprehensive and consistent 
indicators of student performance, i.e., to increase reliability. 

•/ Evaluation methods should udee into account the cultural and ethnic background and the 
prior experiences of students. 

In order for student evaluation to reflect a board range of purposes and student outcomes, educa- 
tors need to use a wide variety of student evaluation practices. Meaningful practices are distin** 
guished by several key characlertislics: they consider all teaching/leaming activities; they measure 
both the product and the process of arriving at the product; they reflect achievement in cognitive, 
affective, skill, and behavioural areas. These practices may include homework, projects, reports, 
quizzes, group work, tests, writing folders, and excursions. 

There are many effective evaluation techniques. Ct'.e of die most common involves paper and 
pencil evaluation, i.e., written tests and examinations. However, there are times when such 
traditional methods are inappropriate. For instance, many of the affective characteristics, like 
resourcefulness and self-reliance that are included in the Ministry’s Goals of Education, arc 
difficult to metisure with traditional methods. Thus other techniques arc necessary to measure the 
many different aspects of learning and to accommcxlaic the students’ preferred learning styles. 

Not all evaluation should result in grades or marks; sometimes evaluation produces feedback to 
students and teachers that promotes further learning without generating a mark. 
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Anecdotal records, teacher journals or log books 

contain systematic and objective narrative records of student accomplishments, needs, progress 
and behaviour. 

Checklists, rating scales or performance charts 

identify and record the students’ levels of achievement or progress. 

Demonstrations and presentations 

display presentation skills in small or large groups, inside or outside the school. 

Independent study projects 

reveal skills such as organization, time management, setting goals, synthesizing and interpreting. 

Input from staff members 

extends an individual teacher’s knowledge. 

Interviews and conferences with students 

reveal unique information and expand first-hand knowledge about individual students. 

Paper and pencil procedures: examinations, tests, quiues, essays 

assess students’ writing ability under a variety of conditions with a variety of models. 

Peer evaluation 

extends the teacher’s knowledge by having students make systematic judgements about one 
another’s performance relative to program objectives. 

Performance assessments 

assess the actual performance of a complex set of activities. 

Portfolios or continuous files 

provide a comprehensive summary of student accomplishment. 

Process folios or files 

contain a student’s initial draft and completed work with accompanying journal entries which 
encourage reflection. 

Self-evaluation 

extends the teacher’s knowledge by having students reflect on their own achievements and needs 
relative to program objectives. 

Seminars that include process, written materials, and oral presentations 
reveal higher order skills such as collaboration, problem-solving, inquiry, synthesis, and evalua- 
tion by individuals or groups. 

Simulations or docudramas 

reveal creativity, analysis, synthesis and evaluation through the use of problem-solving, decision- 
making and role-playing tasks. 

Student Journals 

contain personal records of activities, experiences, strengths and needs. 

Student profiles 

provide a compilation of data, which might include student work samples and ra'ords, attitude 
checklists, attendance rep)orts, or records of community service. 

Teacher observations 

include systematic, first-hand observations of a student by the teacher. 

Video or audio tapes and photographs 

record a student’s performance and accomplishments. 

EVALUATE: WHEN? 

APPROPRIATE TIMES FOR EVALUATION 



%/ Evaluation should occur throughout the tcaching/lciirning process. Evaluation of student 
performance should occur regularly, tliroughout the tcaching/learning prcx:esss, for a variety 
of purposes: 

• teachers, students, and parents/guardians need regular detailed information to be 
kept aware of the students’ progress in relation to the outcomes and to make deci- 
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sions about improving understanding and performance; this is formative evaluation; 



• teachers and students need to determine whether the program, the learning materials, 
the teaching strategics, or the student’s own approach to learning needs to be 
adjusted; this form of evaluation is diagnostic; 

• teachers, students, and parcnls/guardians (as well as others) need to determine the 
student’s achievement in relation to the staled outcomes or at the end of a particular 
unit or period of time in order to make decisions about future directions (e.g., 
promotion, course selection, entry to post-secondary); this is summative evaluation. 

MODIFICATIONS IN EVALUATION 



Evaluation methods should take into account the cultural and ethnic background and 
prior experiences of students. 

•/ individual self-esteem should be a foremost consideration in the evaluation process. 

Evaluation procedures need to be modified for individuals such as English as a Second Language/ 
English Skills Development students, and students with identified exceptionalities 
(communicational, behavioural, intellectual, and physical). 

Such modifications or adaptations should be made to ensure die best understanding of a student’s 
performance. Modifications may include providing more time on examinations, permitting the use 
of a word processor, and substituting oral for written evaluation. 

It is important to consider the stage of a student’s development when selecting or creating a 
measurement procedures strategy. Overall, teachers must be flexible in order to accommodate 
individual needs. 

COMMUNICATION 

EDUCATORS, PARENTS/GUARDIANS, STUDENTS 



i/ The purpose of student evaluation should be understood by the evaluator and by those 
being evaluated. 

i/ 'fhe purposes of student evaluation should be communicated to, and understood by, 
parents/guardians and students. 

Communication is enhanced by frequent contact among educators, parents/guardians, and stu- 
dents. Contact can take the form of meetings, correspondence, telephone calls, and formal and 
informal reports. For information regarding school records, the following documents may be 
consulted: the OSR Guideline Manual and the Municipal Freedom of Information and Protection 
of Privacy Act, 

Communication with parents/guardians and students provides the opportunity for educators to 
share what they value; describe learning opportunities and assessment techniques; provide infor- 
mation on the performance of individual students; obtain relevant information from parents/ 
guardians and students. 

Educators have a responsibility to inform students about the role and significance of evaluation in 
the tcaching/Icarning process. This information can help students to develop a clear understanding 
of the connection bctv/ccn program objectives and the evaluation process; understand the impor- 
tance of practice with a variety ol' evaluation approaches; establish the extent to which they arc 
fulfilling the program objcx:tivcs and the measures they may take to improve ilicir performance. 
Reprinted with ttie permission of the Scarborough Board of Education 
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